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'Introduction 



» ' . • .. , ' . , . 

This report consists of Jfour sections as indicated in the table of 
contents. ■ ' ~ 

, Sections 1 and 2 consist of reports of the two research studies which 
were part of the contract, Section 3 is a series pf abstracts of other 
research studies which were stinrmiated by this contract. These addition- 
al studies were completed as dissertations or were fundea by Bf igham 
Young University research funds. * Section 4 is an-appendix containing 
tlie insti;uctional materials, tests, raw data, and other items of'interest 
.related to this research. ■ . ' ' 

Figures and tables related to a given section are niunbered from* 
lto_N within each section. _These fig\ires and tables appear following 
the text for eacfh section and are printed on yellow paper to facilitate 
the reader's locating this information. 

The contract called for two experimental studies. Both were'com- 
nleted essentially as proposed with some increase in precision of the 
^variableg investigated and with a different apparatus than origiAly pro- 
- posed.--* ■ . ' . . • ^ 

I 

Departure from proposal. ITie or igina)^ proposal called for presenting 
the instructional materials by means of a computer -controlled slide 
projector with the student respohding by me^s of a teletype. After ex- 
pending the funds budgeted for computer rental, and confsiderable time in 
an effort to make this apparatus operational, the plan for using this 
apparatus was abandoned and data was collected using paper and pencil 
devices. All equipment involved as well as personnel for adapting this 
equipment were purchased using Brigham' Young University funds. Funds 
from this proposal were used for computer time in an effort to get the 
system operati6na]|. 

This change^in procedure has little or no effect on the outcome oUhe 
studies. The computer would have allowed slightly mqre control of the 
stimulus material^ but l/his was not a critical variable in,tjiis research". ' 
The proposed apparatus would have also facilitated data analysis. This 
limitation required more time but did not change the amount or type of "\ 
data analysis empldvpH \ 
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AT^TRIBUTE PROMP'HNG VARIABLES 
IN LEARNING CLAS^OOM CONCEPTS ' 



M. David Merrill 
Brigha^p Young University 



Robert D. Tennyson 
Florida State Ui)iversity 



ABSTRACT 



The concept "trochaic meter" was taught to 180 college Ss by 
means ofeight treatment conditions. The independent^ariables in- 
volved ixresenting a definition (D) or instances (E) or both combined 
with attribute definition (A)and/or attribute prompting (P). Dependent 
variables were correct classification and specified classification 
errors. Hypotheses consisted of predictioa of particular errors for 
each treatment. Six of the eighl hypotheses were supported at beyond 
01. The most effective condition for promoting correct classifica- 
tion consisted of D + E ^ A +B. The last effective condition consisted 
of D or E alone. 
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. ATTRIBUTE PROMPTING VARIABLES IN 
' % LEAR^nNG CLASSROOM CONCEPTS ^_ ^ 

M, David Merrill • ■ ' . Robert D. -Tennyson 

Brigham Young University Tloritja State University 

• The need for basic research leading to the developpient of instruc- 
tional theory is stressifed by Qage (1963), Stolurow (1965), Cronbacli 
(1967), Gagne (1969), as well as other researchers. Each, of these 
investigators has emphasized the special chara^vteristics of such ' 
research,, its difference from research on the learning process, and its 
fundamental importance to the development, of any systematic instruc - 
tional technology (courseware). . ^ • , 

Gagne's (1970) hierarchical model makes a distinction between 
eight types of learning outcomes. Category six (concept learning) and 
category seven principle learning) were the concerns of this investiga- 
tion. From an article in Klausmier. (1966), Gagfie postulates that > 
concept learning and pj*incit)le Jlearnihg outcomes require unique forms 
of instruction. Markle and Tiemann (1969) and Mprrill (1971) postufated 
that adequate concept acquisition (the ability to generalize iVithin a 
class and discriminate between clashes) would 'result only if exemplars 
; used during instructfon differed" widely in the irrelevant attributes 
associated' with each; thus promoting generalization within t^e class. 
Also^ discj;inunati(:jin between classes- would result from prei^enting 
nonexenuilars with irrelevant attributes resembling ;those asiS^ociated . 
with given exejpiplars._ ' • 

In a ^tudy by Tennyson, Wooiley and Merr4ir (i971), independent . , 
ariables were investigated that predicted concept acquisition ai^nd 
specified cla;ssification errors of overgeneralization, undergeneraliza- 
tion; and misconceptfon. The results of their study were based' upon 
three independent variablei^: probability, matching, and divergency. 
The group identified as*correct classi.fication (concept acquisition) did 
significantly better on the posttest than the other groups, but^an over- 
generalization behavior still resulted, i. e. , the Ss correctly identified 
all of the examplfes as class 'members, along witR" identifying some 
nonexemplars as members of the class. In that condition, where 
correct classification behavior was hypothesized, some overgeneraliza- 
tion still Resulted. 



The present investigation "is an extension of that design to more 
adequately control ovetgeneralization. Gagne's (1970) paradigm for 
donoept learning is the basis for the indepe;ident variables manipulated 
^ here to increase effe^ii-vehess'of instruction. His-model involves four ' 
■ hierarchical steps-; (l) defining the concept, (2) presenting positive and 
negativ^ instances,. (3) identifyi|{g attributes of "instances, and (4) test- 
^^^r with,previously ^^encountered instances. The Tennyson, 

etal, (1971) study empirically validated the secoAd step and operationally 
defined the relationship within positive in^ances' and between positive 

• and negative instances. / ' ' ^ . , 

• • ■ . ■" - " '.^ * ' 

. independent. Variables 

• Four independent variables are identified and manipulated in ihis • 
study: The first variable is definition presentation, which, consi/ts of 
displaying a statement identifying the relevant attributes" shared'by a ' 

■• ^set'of objects- or evehts in a given class. The second variable is 

attribute defi nition presentation ; in which each attribute of the Concept 
■ class IS defined and clarified for the'"learner . -An exem^)lar/no^exemp- 
ra^presentation is the third variable and consists of displaying- ex - 
emplars and nonexemplars according to correct classifica-tion-procedures ' 
(see WooUey and Tennyson, 1971; for empirical data, see Tennyson 
WooUey and Merrill, 1971). The final independent .variable manipulated 
is a prompting proceSure called attribute priwnpting presentation which 
consists of explanatory information w,hich indicates olass membership 
and also identifies the attfAbiftes for each exemplar or the- absence of 
relevant .attributes ;for each nonexemplar. ^ ' • 

Hypethese s ' \ , 

These four independent variables are not manipulated into every 
possible combination resulting irom a completely crossed statistical 
model. Thfe variables' are organized according to logical sets (1. e: , 

' can be us^ in an instructional situation) which af«e hypothesized'to' ' 
produce aertain behavioral outcomes. These outcomes are defined as- 
correct classification behavior in which S is given previously unencoun- 
tered exemnlars and nonexemplars of a concept,class can pc^rrectly identify, 
undergenerali^ation behavior, in which S identifies th6 more obvious 
^ exemplars as class members, but indicates that l^ss obvious exemplars 
are not dlass meml?ers, i: e. , he fails to generalize- to all members of ' 

- the class; overgeneralization behavior, in which S correctly identifies 
all of the- exemplars as class members, plus identifying some honexemp- * 
lars as members ot the class, i. e.', the S fails to discriminate between 
classes.; and misconception behavior, in which S falsely assumes that 
"--some irrelevant- attribute or combination of irrelevant attributes is ' • 
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relevant. The operationar consequence is that S fails to recognize 
exemplars noi having this attribute as class members, and indicates 

* that nonexemplars, which do have this attribute, are class members. 
» • * * * 

V The 'folio wing conditions are hypothesized (Table 1): (1)*^:' definition 
presentation is hy|)othesized to produce overgeneralization; (2) a 
definition presentation plus an attribute definition presentation is 
hypothesized to prgduce misconception; (3) an exemplar/nonexemplar 
presentation is hypothesized to produce overgeneralization; (4) a^ 
definition presentation plus exemplar/nonexemplar pres^antation is 
hypothesized to produce either corcj^ct clas.sification or a slight over- 
generalization; (5) a definition presentation with attribute definition, 
presentation plus ^xemplar/nonqxemplar presentatipn is hypothesized 
to produce either misconception or overgeneralization (less than 
hypothesized in condition 2); (6) a'n exemplar/nonexexemplar presenta- 
tlQi^plus attribute prompting is hypothesized to produce cvergeneraliza- 
tiofi (less th^n in condition 3); (7) a definition presentation with exemplar/ 

^ noi\exemplar plus attribute identification is hypothesize^ to produce 
correct classification; and (8) a definition presentation with attribute ^ 
definition presentation with exemplars/nonexemplars presientation plus 
attribute identification presentation is hypothesized to produce correct 
classification. This final condition is hypothesized to produce signifi- 
cantly hetiej results than conditions 4 or 7, 



Insert Table 1 about h€re 
Method 



L.earning Task | 



The instructional objective of 'the experimental task was: Given a 
selection of poetry, the S will identify whether \t is an example or not 
an example of trochaic meter. Concept acquisition is required in this 

'task because the S is presented exemplars and nonexemplars in instruc 
tion and then requi^gd to generalize to previously unencountered 

^exemplars on the pbsttest, as well as discriminating unencountered 
nonexemplars. A poetry concept was selected as the task because it 
is generally used in literature classroom curriculum, and^because the 

, irrelevant attributes of poems are infinite. Ninety -five poetry selec- 
tions" were chosen t6 develop the programs and tests. 

To determine which selections to use in the various prpgrams and 
tests, an instance probability analysis, was conducted (Tennyson and 
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Boutwell, 1971).. This procedure has two steps: first, a subjective 
rating of .instances based on difficulty of attributes", and, secondly, an 
empirical rating based on ability of Ss to identify exemplars from a 
group of instanc^^s containing both positive and negative instances. The 
subjective analysis involves defining the concept, establishing a list of * 
relevant attributes from the definition and, a list of the more .common 
in elevant attributes ,(e. g. , author, style, period, rhyme, feet, length, 
*etc.), tl)e divergent pairing of exemplars, and matching of exeniplars 
and nonexemplars. An attribute matrix is constructed of the relevant 
and irrelevant attributes and numerical, weights (1 - 5). The^poetry 
selections were' given a subjective rating .or each attribute and then 
totaled; the higher the selections' score, the lower the probability. 
After all of the selections were rated, and a continuum' of high to low 
probability was established," the empirical a-nalysis waS conducted. 

■ • J, .' . 

A sample of Ss were randomly chosen from the target population and 
presented the definition and poetry selections. The definition used was: 
Part of the rhythm of a poem is determined by the time between stresses 
occupied with unstressed syllables or pauses. Denoting the stress . 
patterns is to establish the meter. One of the major meter scansions 
is named trochee and consists of a stressed syllable followed by an 
unstressed, Syllable (marked thusly: /O). 

Each was asked to study the definition as long as he wished i)ecause he 
could not return to the definition while identifying the selections. 
Probability wa^ then determined by percentage of Ss corrett-ly identify- 
ing each instance. Figure one shows the distributipn of the exemplars 
using a histogram. The probability distribucion for the nonexemplars 
was" skewed in favor of correct identification (Figure 2). The correla- 
tion between the two analyses was . 78. 

^ - r 

Insert Figure 1 about here 



Insert Figure 2 about here 



Procedure 

The programs for the 18 treatment conditions followed the same 
format display: general directions^ pretest on poetry (half the^Ss), 
task, and posttest. $s were administered the progjoam according to 
individual time arrangements. . Upon concluding the general directions, 
read by the E while *S read silendy, the S turned to^pTag&one and began 
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self-instructionr.l , .ogram. In each treatment, half the Ss were given 
a pretest on poetry which required them to identify examples of trochaic 
meter. Following the pretest, the Ss received one of the 18 treatments 
which were previously rand9mly scrambled.' The tasks varied in length, 
therefore, S5 receiving the shorter programs finished in 15 minutes, 
while the longer programs required '60 minutes. The posttest was taken 
immed. itely following the task. The directions asked the S to rea^ each 
selection carefully and identify it as an ex;ample'by writing "yes, " or 
"no" if they thought it was a nonexample. 

» •• .\ ' ' " ' ' 

The programs were printed and stapled together in a sel,f -instructional 
booklet. Once the task began, no questions concerning the program were 
answered by E. Directions required the Ss not to return to previous- pages,, 
and, since the program was nonspeeded, an S could ipend as much tiine 
'per page as desired. 

* » ' * 

Independent Variables 

Manipulation of the four independent variables determines the type 
of behavior to be elicited from the Ss . A definition, as the first 
variable, of the concept class b^sed on the relevant attribut-es, is 
primary to the task. The definition should be as concise as possible so 
that prerequi§ife"cohcepts can be identified. It should be assumed that 
the Ss can perform ^tAe subconcepts identified in the definitian-^Ce^g. , 
know what stress ma*ks represent, identify syllables, etc. ), Represen- ^ 
tation of the topic cannot be arbitrary and jail isxamples 'must be consis- 
tent with the, identified relevant attributes. The second variable of 
attribute dQfinition is clarifying jJ^Tthe subconcepts' presented in the 
definition. .This varfable pfovicjes the S with a review, and if necessary,-)' , 
anf explanation of ihe^ntended ifieiining of the subconcepts in reference ^ { 
to the definiiioifT In*th6 poetry^task used in this experiment, the attribute^ 
"definitiorTpresentation was: ' ^ « . 

Words are camposed of at'lpast one, syllable. Each syllable constitutes 
an elementary sound (diphthong) produced by a single impulse or utterance 
and constitutes the word or a part* of the word. Adjoining syllables in a 
^word or phrase are marked by abatements, Renewals, or reinforcement3 - 
of the stress so that there is the feeling of/separate impulses. 

Language pattern? have established the pronunciation words. The 
syllabi es are inherent iii the language and vary only sligh^y with varying 
dialects. Some syllables, such as ing, are generally unstressed or soft. 
Other syllables, such as pro are generally stressed (given more empha- 
sis when' verbalizing). These naturally stressed and unstressed syllables 
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combine to give variety to language. Poetry carefully uses patterns 
that can'result when words are grouped according to the stressed and 
unstresse^ syllable's. For example, a line of words that follows this 
pattern: ^tress, unstress, stress, unstraes; gives a different effect 
tha*i this ijattern:^ stress, stress, unstre.^s, stress, stress, unstress^. 

Each of the pattern possibilities have been named for reference. 
And stressed syllables are marHed with a diagonal line above the 
syllable (e. g., danc ing). Unstressed syllables have been given 'a 
small.ar^c marking (e.g. , danc ing). The marks are placed directly 
above the referent syllable. This program will deal with justx)ne pat- • 
' tern used in poetry: Trochee (markfed thusly: /^). It consists of a 
stressed syllable followed by an ynstressed syllable. 

Trochaic tmeter produces ^a more powerful effect than most other 
meters.. It 'can convey boredom, frustration, supernatural, or anger, 
because it starts with a strong beat and it is short. The chants, of tlie 
American Indians were "often set to trochee. The reader must determine, 
in any poem', which-syllables are to be stressed. ' 

The t . laic line often finishes with a strong beat --a masculine 
ending. ets generaUy^void sustained trochaic measure because 
of the tendency for it to become "monJStonous. Children gener,ally i 
enjoy the beat,'however, and it is often-usjsd in short songs. 

• The r^elationship between exemplars and nonexemplars is the third 
variable investigated. A matched relationship assumes that the 
exemplar and nonexemplar are to be as similar as possible in their 
^irrelevant attributes^^ the case of th poetry task, this would mean \ 
having similar rhyme, feet, length,, style, author, period, etc.> Another 
relationship- assumed in this same variable is between exemplars. Two 
exemplars presented in correct classification (cf. , Tennyson, WooUey, 
and Merrill, 1971) are divergent when the irrelevant attributes are as " 
different as possible- An example is the following exemplar set with 
divergent exemplars matched with nonexeniplars: 

Out of childhood into manhood 
Now had grown 'my Hiawatha 
. ^ (Longfellow) - 

Come tr fhe ci^ag where the Ipeacon 

is blazing 
Come with the butkler, the lance, 
ajnd the bow 

(Scott) " 



— Example: — 

s 3 

^ Not an Example: -J^ 
> 

, } 

(Cbnt.) 
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-Exapiple:- 



n3 

x: 



Not an Example:^ 



Pansies, lilies, kingcups, daisies, 
(Wordsworth) 



"Motherly, Fathei'iy, Sisterly, Brotherly! 
^ (unkTnown) 

This variable identifies for the S.an example and a nonexample. It 
doe^ hot, however, explain why. The final variable manipiilated, in this 
study dqesdescribe the rationale for selection. Each instance presented 
include:s^tatement which identifies the relevant attributes an^ why they 
are relevant. For the nonexamples^ the.absence of the relevant attributes 
is noted and explained. An example is given here from the experimental 
task: 



I There they are my fifty 
men and women, < — 

Naming me the fifty poems 
unfinished ! 

(R., Browning) ' 

'Tis hard to say if greater 

want of skill ^ 

Appear in writing or 
judging ill. 
(Pope) 

Boys in sporadic, 

tenacious droves 

Come with sticks, as 
certainly as Autuhm.' 
(Eberhart) 
^ y mind to me a 

^kingdom is, < 

Such present joys therein 
I find. ' 

(Dyer) 



Example 



Not an 
Example 



Example 



Not an 
Example 



By stressing there, the word 
catches the attention of the: 
reader .and_.leads to the emphasis 
ending with the exclamation 
point. 

Words such as 'tis, to, if, -er, 
and of are not stressed because 
they do not' carry the message 
as do the* stressed syllables.^ 



This selection illustrates the 
masculine line ending wherein 
the final syllable is stressed. 



When reading* this poem in a 
natural manner, the second, 
fourth, sixth, and eight4r^ 
syllables are stressed. To 
alt^r this* produces a strained, 
vexing effect that was hot in-w 
tended by the poet. 
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Test 

The te^t was constructed so that th,e predicted response's of the 
defieiident variables could be analyzed. Thirty selections of poetry were 
sectioned into three parts with the following format: 

1. Convergent high probability exemplar. 

2. Convergent lov/ probability exemplar. " 

3. High probability nonexemplar inatched to number 1. 

4. Low probability nonexemplar matched to number 2. 

5. High probability nonexemplar unmatched. 

6. Divergent high probability exemplar paired to number 1. 

7. Divergent low probability exemplar paired to 'number 2 . 

8. High probability nonexemplar matched to number 6. x 

9. Low probability nonexemplar matched to number 7. 
10/ Low pi;x)bability nonexemplar unmatched. 

The thirty selections were randomly scrambled so that no patterns were 
evident to the Ss. To test the dependent variable of misconception the 
grouping of Victorian.period poetry was identified as convergent- all 
other grouping was classified as divergent. ' 

The hypothesized response patterns for each of the dependent variables 
are given in Table 2. Responses for each S were compared-with the 
predicted score for each dependent variable. S was scored with* an error ^ 
for a given dependent variable when his response to a given item differed 
from the predicted response. Scores were obtained for the three selec- 
tions of the test and then kdded together for the four separate dependent 
variable conditions. This procedure gave each S four scores; one for 
each hypothesized dependent variable. 



Insert Table 2 about here 



Experimental Design 

A Solomon Four group experimental design was used so that inter- 
action of pretesting and treatment could be analyzed to control external 
validity (Campbell and Stanley, 1963). Internal validity was controlled 
by random assignment of & to the 18 treatments. Since the programs 
were administered to individual 3s, the basic experimental unit was the S. 
The n-size for each cell was 10, total N=180. A two-way analysis of V^arf- 
ance was used to analyze the data; One main effect was. treatment with 
pretest versus no pretest as the other. 
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Subjects - ' ' ' ' ' • 

The instance probability analysis was conducted with 105 spring 
sejfnester undergraduate educational psychology Ss enrolled at Brigham 
Young University (BYU).. The additional 180 Ss who participated in 
the experiment were randomly chosen from all BYU students enrolled 
in the spring semester educational psychology classes. 

Results 

• Variable Measures 

Four error scores were obtained for each S according to hypothe- 
sized responses on the dependent variable (Table 1). Table 3 shows t'he 
treatment groups, represented by nmemonic labels (see Table 1) and 
the predicted errors for each dependei^variable, i.e. , groups,DEP and 
DAEP would make zero errors under th^orrect classification variable, 
but it was predicted that groups D, DE, DAE, E, EP would mike eight 
errors, while group DA would make nine errors. No groups were pre- 
dicted to undergeneralize but the groups were scored on this variable 
to validate that assumption. Thus, each group was predicted to make 
significantly feAveV 'eVrors than the_other conditions when its dependent 
variable was analyzed." Likewise, the other variations in error scores 
' per group were predicted. 



Insert Table 3 about here 



A t\yo -way' analysis of variance was used for each dependent variable. 
For the correct classification scoring scheme, the main effect of treat- 
ments was significant at the . 01 level (8, 162 df, F = 23. 67). The pre- 
test versus no pretest effect and interaction were not significant (p>.05). 
With no difference on the pretest, the nine means for the treatment effect 
were used to determine differences between conditions with the Newman - 
Keuls Sequential Test. The mean error scores Tor the treatment groups, 
according to the dependent variables, are listed m Table 3. The remain- 
ing F^ tests were: Overgeneralization, F = 15.B7 ,(p<.OI); undergeneral- 
ization, F = 29.7d(^<.01) and misconception, F = .4. 83.^<. 01). 

Correct Classification . . ■ 

The correct classification dependent variable outcome was hypothe- 
sized to result from two instructional procedures. These two conditions 
(Table 1) were constructed of the definition, exemplar/no nexemplar, and 
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attribute prompting presentations. One group also included an attribute 
definition presentation. Thesf two conditions did not differ in mean 
scores (g^>. 05). The two groups did have lower mean error scores 
(p<.01) than the other conditions except for group DE. Only Group 
DAEP differed from group DE (p<. 05).' Group DE was predicted to 
overgeneralize wjth eight errors', while group DEP was hypothesized 
to make zero errors. The D group, receiving just the definition, and 
the E group, receiving just the exemplars and nonexemplars, did not 
differ (p>.05). In both cases the mean error scores were slightly 
better than the control group (pr. 05). The DAE group varied from the 
DEP and DAEP groups (p<. 05r, but not from group DE (p>. 05) Con- 
dition group EP, likewise, differed from groups DEP and DAEP (p<.01) 
and group DE (p<. 05) but failpd to vary from group DAE (p>. 05).~In 
the latter cases, no differences were predicted. 

O vergeneralization 

The over generalization dependent variable was predicted from con- 
ditions that did not include sufficient independent variables to teach 
discrimination. Group D and group E had the lowest mean score on 
this variable (pC.Ol). Treatment groups DF., T^\r? oriH ep, while 
different from the previous groups, also, varied frpm the misconception 
group DA and the correct classification groups DEP and DAEP (p<-.01). 
No differences were predicted between the overs.eneralization groups. 
The control group was significatnly different from the experimental 
conditions (p<. 01). -^^ 

UndergeneralizaiiQn 

None of the treatment condition Ss were predicted to undergeneralize 
in their responses. The correct classification groups, DEP and DAEP, 
were more conservative in their responding on the posttest than the other 
groups (pCOl). Th° only exceptions were groups DE (pi>.05) and DAE 
(p<.05). Groups D, DA, E, and EP were presented decreased amounts 
of instruction resulting in increasingly liberal responses. All conditions 
except the misconception and correct classification were predicted to 
score the same, yet group D has mean errors higher than all (except 
group E)^xperimental conditions (p<.01). Only the control group made 
more responses. The two correct classification treatments (groups 
.DEP and DAEP) were not different from group DE (p>.05), even though . 
eight points were predicted. Groups DE and DAE showed no changes 
(p>.05), however, the latter group did differ from the correct classifica- 
tion groups (p<. 05). 
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Misconception ^ 

\ 

The misconception variable was built info the posttest to determine, 
if Ss receiving the definition'plus the attribute definition presentation 
woujd assume an irrelevant attribute in the attribute 'definition to be a 
relevant attribute. There were no differences between the experimental 
conditions (p^>. 05), the only variance was the control group and the ' 
experimental (p <. 01). . ' . 

■ Discussion 

Corfcept acquisition research differs from the traditional concept 
attainment ^brk in that the former is a deductive instru<itional system. ' 
The .learner is given the rule or definition, presented a series of 
instances and teste'd with previously unencoiintered instances to deter- 
mine transfer. Glass (1968) emphasized this type of research, u^ing 
school related instructional paradigms as 'well as real subject matters. 
This type of investigation would have inimediate application to .teaching 
situations. Variables that do effect instruction are basically of three 
types: stiiriulus similarity variables, prompting feedback variables, 
and sequence variables. 

, In the Tennyson, Wooiiey aud Merrill (1971) study,, the first variable of 
stimulus similarity was, investigated, iheir results indicate that a 
relationship between instances can be operationally defined so as to 
influence S responses after instruction. Concept attainment research, 
or other studies in jise of negative instances, hkve not developed the 
telations^hip of exemplars and nonexemplars (e.g. , SmokC; 1933; 
Bruner, Gobdnow, and Austin, 1956; Donaldson, 1959; Hovland and 
Weiss, L953). Tennyson and Merrill (1971) replicated the earlier study 
of Tennyson etal (1971), but, also, the effect of removing the nonexemp- 
lars from the instruction. The results showed that the Ss did not , . * 
discriminate between exehiplars and nonexemplars. The relationship 
between.the two instances forces the learner to fociis on the relevant 
attributes 'and not be confused by the if relevant attributes. The results 
of those two studies (cf. Merrill and Tennyson, 1971) indicated that a 
definition plus exemplar^s/nonexemplars in' the . Correct classification 
format still* taught a slight overgeneralization. Divergency., as. the ' 
other relationship of instances maintains that two exemplars are 
presented which ^re as different as possible iji their irrelevant attributes. 
This allows the learner to see the range of the concept class. 

Probability of instances was an important factor because difficulty 
of instances was a function of the number and weight of irrelevant 
attributes. To extend thost studies with the addition of the prompting 

V / 
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variables was the goal of this investigation; 

The prompting Variable, by identifying the relevant attribute in^each. 
exemplar and the absence of the relevant attributes in npnexemplars, 
would further ekplain the definition 'of the concept. In a study by WooUey 
(1971), ^Ihe more information presented to the learner -would result in 
increasingly conservative r^ponses. An anology in statistics is the 
type n error, in that Ss woura be willing to reject a true hypothesis * 
rather than accept a false hypothesis. TJiis study confers this assump- 
tion in Chat the two correct classification groups had the fewest errors 
on the undergeneralization dependent variables measure. Given a 
minimum amount of instruction, results in liberal responding closely 
res enjbled random choices. 

When given just a. rule or .definition, Group D, the Ss did slightly 
better than the control group. Adding an explanation of the subconcepts 
cphtained in the definition improved performance. Exemplars and 
nonexemplars without the rule^ Group E did the same as the rule-only 
condition group. The variable which seemed most powerful was the 
attribute prompting. When this was added to the exemplars/nonexemplars 
qnly presentation, the 'error' rate dropped significantly. The definition 
plus exemplars/nonexemplars condition had the same mean as in the 
Tennyson,' Wjaolley and Merrill .(1971) study, (p>. 05) on the same task. 
With the additioix of the prompting variable .and the attribute definition of 
the subconcepts, th& error mean dropped significantly lower. 

« 

The results of this study introduce a paradigm of instruction for 
concept teaching. The variables are not limited to a particular mode of 
instruction or medium of presentation.. The procedures c^n be readily 
applied 'to various subject maft^er areas or any existing instructional 
system. Extensionsof this study would be on the sequencing variable, 
, such as simultaneous versus sequential presentation of exemplars and 
nonexemplars; various forms of review, e.g. , specific review; adaptive 
instructional models, which would include the variables investigated for 
individual differences, e.g., ability, rate, trait, etc. 
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Table 1 
Hypothesized Outcomes 
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Treatment 

'j: 



i; Definition Presentation only 



2. Definition- Presentation,' 

plus 

.Attribute Definition Presentation ! 

3 . Exemplar/ nonexemplaf V 

Pres^ntatiori 

4. Definition Presentation 

plus * 

Exemplar s/nonexemplars Presenta- 
, tion 



5. Definition Presentation with 
Attril^yte Definition Presentation 
plus 

Exemplar/nonexemplar Presentation 



6 . Exemplar/ nonexemplar 
presentation plus ^ 
Attribute Prompting Presentation 



7,. Definition Presentation with \ 
Exemplar/ nonex:emplar ) 
plus 

.Attribute Prompting Presentation 

8. Definition Presentation with 

Attribute Definition Presentation with 
Exemplar /nonexemplar Bresentation 
plus 

Attribute Prompting Presentation 



Nmemonic 
Labels 



D 



DA 



E 



DE 



DAE 



EP 



DEP 



DAEP 



l>ependent Variables 



Overgeneralization ' ' 



Misconception 



idv 



Overgeneralizati 



Overgeneralization 



\ 



Overgeneralization 
or Misconception 



Overgeneralization 



Correct Classifica- 
tion • ' 



Correct Classifica- 
tion 



2.i 
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■ Table 2 
Scoring Sheet 



Dependent Variable 



SET # 1 



M 



u 



1. eg? #6 



2. e^#16 

s 

.3. e^n, 

I 

4. e^#30 

5. et#15 . 




10. eg M 



+ 
+ 
? 

* 9 



+ 
+ 
? 
+ 
? 
+ 
+ 
? 
+ 
+ 



+ 



+ 
+ 



+ 
+ 



Note. --Predicted responses according to conditions. M = mis- 
conception; 0 = overgeneralization; U = undergeneralization; C = 
correct classification; + = S indicates that sentence is a positive 
instance; - = S indicates this sentence is a negative instance; ? = 
Sjrould classify as either, no error possible; eg indicates an exemplar 
eg in&cates a nonexemplar; # refers to Original test item number! 
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CONCEPT ACQUISITION AND SPECIFIED EkRORS 
AS A FUNCTION OF RELATIONSHIP^.B&TWEEN 
POSITIVE AND NEGATIVE INSTANCES 



M. David Merrill 
Brighairi Young: University 



Robert D. Tennj^son 
Florida State University 



ABSTRi\CT 



• 

. Four instructional strategies for promoting the acquisition of an 
infinite concept class were investigated. The independent variables 
were: 1) Probability level of concept instances determined by Ss who 
correctly classify the item as an exg^nple or 'a nonexample; 2) Match- 
ing of positive instances to a negative instance so that the irrelevant 
attributes are similar; and 3) mvergency of positive instances with one 
another so that all of their irrelevant attributes differ. Positive in- 
stances that share irrelevant attributes are convergent. The manip- 
ulation of the independent variables predicted four aependent variables: 
1) correct classification; 2) overgeneralization; 3) undergeneraliza^ion; , 
4) misconception. Undergraduate educational psychology students 
enrolled at Brigham Young University were selected as the 100 Ss, The 
four predicted outcomes were all significant at 01. 
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CONCEPT ACQUISITION AND SPECIFIED ERRORS 
ASA FUNCTION OF RELATIONSHIPS BETWEEN 
POSITIVE AND NEGATIVE INSTANCES 

M. David Merrill • Robert D. Tennyson ' 

Brigham Young University Florida State University 

Controversy has resulted in.concept research concerning the value 
of negative instances (nonexemplars) and their relationship to positive' 
instances (exemplars) in promoting concept attainment. The earliest 
study dealing with the relationship was Smokes' (1933). He concluded 
that negative instances were of no value in concept learning. Smoke 
used an artificial task in which the exemplars and nonexemplars were 
randomly ordered. This order was changed after each succession 
through the list. No logical relationship was established between ex- 
emplars and nonexemplars. A study which sought to look at the re- 
latibnship of exemplars was Morrisett and Hovland's (1959) replication 
ofr;Aciams' (1954) study of single vs. multiple task. They found that 
a variety of positive instances were necessary to effect a transfer 
(generalization) of concept learning. No attempt was made, however, 
to establish an operational definition of the relationship between ex- 
emplars based on their irrelevant attributes, or on any other criteria. 
In studies of combined instances, the equivalent attributes of positive 
and negative instances were found to be poorly utilized by human sub- 
jects (Bruner, Goodnow, and Austin, 1956; Donaldson, 1959; Hovland 
and Weiss, 1953). These studies show. the lack of control between ex- 
emplars and nonexemplars as does the Smoke study. The concepts 
were finite with the S attempting to guess the rule (relevant attribute) 
from a series of instances. Callentine and Warren (1955) studied 
positive instances and concluded that repetition of one or two instances 
increased attainment. Luborsky (1945) indicated that eight exposures 
was more effective than three. These last two studies show that a 
series of instances is needed, but no mention is made of the difficulty 
(probability) of the instances or tliat discrimination of negative instan- 
ces could be affected by a series which included a combination of ex- 
emplars and nonexemplars. Two studies which used negative instanc.es 
as an int^grajjunction o£ instruction resulted in efficient learning 
"tHuttenlocher, 1962; and Friebergs and Tulving, 1961). 

Irrelevant attributes as measures of difficulty have been shown in 
the studies dealing with ease of attainment of concept classes (Archer, 
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Bourne, and Brown, 1955; Brown and Archer, 1957; and Bourne, 195T). 
Each of these studies found that as the number of irrelevant attributes 
increased the learning latency and number of errors also increased. 
They concluded that the number of irrelevant attributes has a linear 
relationship -^^ith difficulty of instances. 

Concept acquisition deals with infinite conce^jt classes as contrast- 
ed with finite classes aa used in concept attaijnment research (Cronbach, 
1967). An infinite class is one in which all of the irrelevant attributes 
^ associated with a given exemplar cannot be specified. . The procedure 
" for presentation is deductive in that S is told what are relevant attri- 
butes and then is given exemplars and nonexemplars prior to the 
criterion task of identifying class membership. Once an instance has 
been presented and identified by the's, it is no longer useful as an 
iteiii to measure this behavior. 

Mechner (1965) defined concept acquisition as generalization within 
a class and discrimination between classes. He pointed out that un- 
less both processes were assessed simultaneously it was not possible 
to infer concept acquisition. In order to assess concept acquisition, 
both exemplars and nonexemplars must be presented to the S and his 
ability to generalize to new exemplars and discriminate them from 
nonexemplars is observed. Markle and Tiemann (1969) and Merrill 
(19TI) postulated that adequate concept acquisition would result only if 
exemplars used during instruction differ widely in the irrelevant 
attributes associated with each; this promotes generalization within 
the class. Also, discrimination between classes results from pre- 
senting exemplars which have irrelevant attributes resembling those 
associated with%iven exemplars. ^ 

Markle and Tiemann (1969) also postulg^d that unless the above 
conditions were met, certain classification behavior errors would re- 
sult. These are: overgeneralization, undergeneralization, and mis- 
conception.' Overgeneralization occurs when S correctly identifies all 
of the exemplars as class members, plus identifying some nonexem- 
plars as members of the class, i. e. , the S fails to discriminate be- . 
tween classes. Undergeneralization occurs when S identifies the more • 
obvious exemplars as class members but indicates that less obvious 
exemplars are not class members, i. e. , he fails to generalise to all 
members of the class. A misconception results when S falsely 
assumes that some irrelevant attribute or combination'of irrelevant • 
attributes is relevant. The operational consequence is that S. fails to 
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Tfecognize exemplars not having this attribute as class members and in- 
dicates that nonexemplars which do have this attribute are class members. 

In a study by Tennyson, WooUey, and Merrill (1971), independent 
variables were investigated that predicted concept acquisition and 
specified classification errors. The results of their study were based 
on three independent- variables; probability, matching, and divergency 
The probability variable referred to the difficulty of the instances. 
Probability of 'each instance was a percentage of students who correctly 
identified it given only a definition. The rating was taken on a sample 
from the target population. The matching variable refers to the relation- 
ship between exemplars and nonexemplars. A matched condition was 
defined as instances having similar irrelevant attributes. Divergency 
referred to Wie'relationship between two exemplars. Exemplars were 
divergent when their irrelevant attributes were as different as possible. 
By logically manipulating the three independent variables into four treat- 
ment conditions, Tennyson et al . , predicted four dependent variables 
They were 1) Correct Classification, all instances, exemplars and non- 
exemplars, correctly identified; 2) Overgeneralization, nonexemplars 
similar to class members identified as exemplars; 3) Uhdergener alization 
low probability exemplars identified-as nonexemplars: and 4) Misconcep - 
tion^ exemplars and nonexemplars sharing a common irrelevant attri- 
bute identified as class members. The four strategies consisted of 
presenting to S a definition and task according to the hypotheses; 1) 
IF high to low probability, divergent, and matched, THEN correct 
cl-assification. 2) IF low probability, divergent, and not matching THEN 
overgeneralization. .__aHrjiigb probability, divergent, and matching, 
THENundergeneralization. 4r IFiiigh-talow^probability, convergent, 
and" not matching '^HEN misconception. A score^on-each independent 
variable was determined for each S on a specially constructed test re- 
quiring S to identify 30 instances as exemplars or nonexemplars. 

In ^n extension of the above study, Tennyson and Merrill (1971) re- . 
moved the negative instances from all treatments on a task dealing with 
the grammatical concept of adverbs. When Ss received the task with- 
out non-instances, they randomly responded'bn the posttest. Results 
indicated that the Ss failed to acquire the given concept when presented 
just positive instances. The failure was both a generalization and dis- 
crimination problem. 

Independent Variables ' * 
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The purpose of this study was to operationalize the procedures 
for selecting the instances. The methodology involves defining the 
^ concept class according to relevant attributes. Instances are identi- 
fied as exemplars if they have all of the relevant attributes. The de- 
fining attributes vary in difficulty on two dimensions: the population 
for whom the instruction is intended; and, difficulty of irrelevant 
* attributes in distracting the S. To account for irrelevant attribute 
contingencies, the more common ones are identified. The resulting 
attributes are weighed on a 1-5 scale according to a subjective 'rating 
by a subject matter expert. An instance then has an overall prpbabil- 
ity Yating when the weights are totaled: The higher the score, the 
lowec^the probability. , ' . 

Instances are organized intp exemplar sets according to the vari- 
ables of divergency and matching. An exemplar set is composed of 
two exemplars whicj^ differ as much as possible in their irrelevant 
attributes and two nonexemplars which are matched, one to each ex- 
emplar, according to similar or irrelevant attributes. This procedure 
controls task development by: limiting the definition to the relevant 
attributes (controlling surplus meaning); it identifies the subconcepts 
with the assumption that the Ss can perform them; in selecting in- 
stances a range of difficulty can be maintained; and the construction 
of the sets allows a thorough distribution of the concept class. This 
subjective analysis is then empirically analyzed. ^ 

V 

The second component of the instance prpl)ability analysis is the 
collection of the empirical data. A sample of Ss randomly picked 
from the'target population are given the definition of the concept and 
the list of instances (randomly scrambled) from the subjective analysis. 
The Ss identify each instancy as either an example of the class or not. 
Probability is then determined by percentage of Ss correctly identifying 
each instance. If the subjective analysis was rigorous, the instance 
probabilities shquld follow a noimal curve. 

Based on the above methodology for identifying instances, the three 
independent varia^^es manipulated in this investigation were: 

1) Probability : All exemplars and nonexemplars, preceded with a 
definition of the relevant attributes^ were presented to Ss, - High 
probability items are those instances correctly classified by 60% or 
more of the sample; medium probability are those correctly classified 
by more, than 30% but less*than 60%; and low probability are those in- 
stances correctly classified by less than 30% of the sample. 

e 

*^ I 
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2) Matching: An exemplar and npnexemplar are matched when 
the irrelevant attributes of the two. are similar as possible. An un- 
matched relationship between exemplar and nonexemplar occurs when 
the irrelevant attributes of the two are as different as possible. 

c / 

3) Divergency: Two exemplars are divergent when the irrelevant 
attributes of the exemplars are as.different as possible. This relation- 
ship assumes the same probability level. A convergent relationship 
occurs when the irrelevant attributes are as similar as possible. 

The tour hypotheses resulting from the same manipulation of the 
variables were also the same (l^ble 1). Implied in 
this study are what Stolurow (1969) referred to as 'teontingency rules " 
which specify: who is being taught, what is critical, and how the in- 
struction is to be done. Stolurow conceived of contingency rules- as 
^ If. . . . and. , then. ..." statements. In the context of this study, the 
If segment ctfntams particuUr variables identifying the instruction 
(this IS a combination of Stolurow »s 'if and 'knd" segments): the -then- 
segment contains the predicted outcome or dependent variable 
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Method 

Learning Task' 



The instructiotol objective of the task was: Given a picture of a 
crystal the S will identify whether or not it is a RXo crystal. Concept 
acquisition was required because the S was presented exemplars and' 
nonexemplars in instruction and then.required to generalize to previous- 
ly uneneountered nonexemplars, on the posttest, as well as discriminat- 
ing unencountered nonexemplars. This concept was chosen for three 
reasons. First: the concept provides an unlimited number of instances. 
The molecule arrangements would never appear twice. Second- the 
concept meet^Glaser (1967) and Suppes (1966) concern of using tasks • 
that represent "real" subject-matter learning. Third: Ss would-not 
have previous knowledge of the concept. The definition of the RX 
crystals was: _ ^ 2 

I Cryst?.ls are made up of groups of identical molecules which ai-e com- 
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prised of spheres called atoms. The single crystals y9u are to be 
tested on may not be complete in and of themselves, but remember 
that crystals are always synfimetrical, so what you don't see may 
still be present. You must attune yourself to the basic atomic struc- 
ture or the repeatifig qlusters of atoms. There is a typ,e of crystal 
called RX2 which has a two to one ratio in its atomic structure, i. e. , 
for a given atom there will be another two atoms (or cluster of atoms) 
attached to it in repeating fashion. 

Procedure 

The programs for the five conditions (the four treatment groups 
and control group) followed the same format display: general direc- 
tions, pretest on crystal identification (half the Ss), task, and posttest. 
Upon concluding the general directions, read by the E while Ss read 
silently, the Ss turned to page one and bejgan the^self^instructional 
program. Half , the Ss in each condition Were given a pretest. This 
requirj^ Ss to identify RX2 crystals from a list containing beth 
4)ll>itfve and negative instances. Following the pretest, a definition 
and beief explanation of crystals was presented to all Ss except those 
in the control group. The only instruction for the rest of the program 
was the presentation. ol 16 crystal pictures. The format of the exem- 
plar/nonexejTiplar displays consisted of four sets (two exemplars and 
two nonexemplars) of crystal pictures— one exemplar and one non- 
exejrnplar per page (Figure 1). When finished with the unspeeded pro- 
gram, all Ss took the posttest on RX2 crystal identification. At the 
conclusion, of the posttest, the S turned in the program and left the 
testing room. 

— ^ - / 

I. 

Insert Figure 1 about here 



The programs were printed on high quality paper so that the pictures 
of the crystals would be clear and free from distortion. This was an 
important consideration because identification was based on a visual 
presentation only. Each program was fastened in a colored folder and 
looked identical on the outside. Responses on the tests were made on 
L B. M. Jinswer sheets. . 

Treatment Programs 

The instance probability analysis involved two major components: 
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1. a subjective rating of instances^based on number of irrelevant attri- 
butes; and 2. an empirical rating balsed on ability of random sample 
of Ss from the target population to. identify exemplars from a group ot 
instances. One hundred crystal pictures were selected according to the 
procedure outlined in the independent variables section. This provided 
a subjective range of instances which were presented to 100 Ss for the 
empirical rating. The Ss were randomly divided into four groups and 
identified the instances while viewing each crystaUpresented on an over- 
head projector. The .definition was handed each S and was available 
during the identification. A histogram was constructed tD check.the 
distribution of instances. 

The four treatment condition programs were developed according to 
the hypotheses. Programs were administered to several Ss who com- 
mented individuality on the program. Several chai^ges were made as a 
result'e. g. , the instructions were not totally clear/ the definition was . 
shortened by eliminating the attribute cjefinttion, a*d some editorial 
changes. ^ - * 

For the correct classification program, the exemplar sets were 
arranged from high to low probability. Page one and two had a high 
probability set of divergent exemplairs with matched nonexemplars 
followed on page three and four with a high-medium set, page five and 
sixwith a low -medium set, and page seven and eight with a low pro- 
bability set. This task was hypothesized to result in a S generalizing 
to all exemplars on the RX2 crystals posttest and discriminating the 
nonexemplars by not identifying them as exemplars. 

The overgeneralization program was constructed of only low prob- 
ability instances. All eight pages of the program were low probabilitj? 
exemplars. However, the noAexemplars from the sets were chknged. 
The new nonexemplars were randomly chosen from other sets. Such 
an unmatched situation would prevent the S from distinguishing the 
relevant attribute of RX2 crystals from some other crystal structure. 
This situation is the condition found in concept attainment research in 
which the S sees no relevancy in the negative instanpes* And as a 
result, the S fails to develop\i discrimination strategy. 

The undergeneralization task was constructed of only high probabil-' 
ity exemplar sets. Since the non'exemplars were matched, the entire 
set was used. The first two pages Qf this program were the same as 
the correct classification program, with the succeeding pages on an 
equal level of difficulty. By using only exemplars that had easy sub- 
jective rating^ and probability ratings above 60%, it was hypothesized 
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i 

that Ss would not generalize to previously unencounterfed low probability 
instances because they had not seen the difficult irrelevant attributes. 

For the misconception prc^ram, the convergent grouping was the 
irrelevant attributes--solid black molecule with-a white mark. This 
attribute was chosen after discussing with eight Ss what they were 
looking at as aids in idehtification. The set included high and low 
probability ratings. Nonexemplars randomly picked from other sets 
replaced the matched nonexemplars. With the use of exemplars con- 
taining the irrelevant black molecule and wtth unmatched nonexamples " ' 
thai did not have that particular irrelevant attribute, it was hypothesiz- 
ed that the Ss receiving this condition would resp&nd to the irrelevant 
attribute whether they were RXg crystals or not. ' 

Test^ 

. Tlie pretest consisted of 15 crystals. The items were selected after 
the four programs and posttest instances-were chosen. The posttest 
items were taken from the same pool of crystals as the programs. For 
concept acqui^on this implies items which were not used in instruction 
or on the pret^t, i.e., previously unencounte^ed instances. Test con- 
strue tion/ioUowed this outline: 

1. .Convergent high probability exemplar. y ^ 

2. Convergent low probability exemplar. 

3. High probability nonexempiar matched to number 1. 

4. Low probability nonexempiar matched, to ftumber 2. 

5. High probability nonexempiar unmatched. [ 

6. Divergent high probability exemplar paired' to number l". ' 

7. Divergent low probability exemplar'paired to number 2, 

8. High probability nonexemplatm^ched to number 6. 

9. Low probability nonexempiar matched to number 7. s 
, 10. Low probability nonexempiar unmatched. 

The purpose of the above system is to predict S responses according to 
type of exemplars and nonexemplars used in instruction. Any number 
of the above sets can be included in a posttest. For this study three 
sets were used. The 30 pictures were randomly scrambled so that 
no patterns were evident to the Ss. To jtest the dependent variable of 
misconception, the crystals with black molecules were identified as 
convergent, all other molecules were classified as divergent. Ss in the • 
misconception treatment condition were hypothesized to classifjTonly ^ 
convergent high and probability exemplars and identify as exem- 
plars those matched nonexemplars. The classification treatment group 
was hypothesized to correctly classify all exemplars on the test. 
The overgeneralizfition treatment group was hypothesized to classify 
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^not only the exemplars, but also to classify the low probability matc'hed 
nonexemplars as positive instances. They could also pick high prob- 
ability matched and unmatched nonexemplars and not be penalized by 
an error, i. e. , a S in this group could have classified all 30 items as 
exemplars and still follow the predicted results. Undergeneralization 
Ss ^ere hypothesized to respond only to high probability exemplars. 

. The hypotheses were stated so that the resulting condition would" 
have fewer errors when its scoring pattern was, used against the dfher 
groups (Table 3), e.g. , the correct classification group would have 
zero errors, while the over-generalization group would have eight errors 
the undergeneralization group having the most (nine). For each of the ' 
^- other dependent variables, when scored with its pattern, the error 
would be zero. ' 

The hypothesized response patterns for each of the dependent vari- . 
ables are given in Table 2. S responses were compared with the pre- 
dicted score for each dependent variable. S was scored with an error 
for a given dependent Variable when his response to a given item differed 
from the predicted response. Scores were obtained for tlje three s^tions 
of the test and then added together for the four separate dependent vari- 
able conditions. This procedure gave the S four scares; -one for each 
hypothesized dependent variable. ~ 
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Experimental Design 

A Solomon Four design was used so that interaction of pretesting and 
the treatment could be analyzed to control external vaiiditv (Campbell 
and Stanley, 1968). This design is constructed so that for'each treat- 
ment, one half of the S receive a pretest and the other half of the Ss do 
not. ■ Generalization is increased if the main effect of pretest versus 
pretest is nonsignificant. A twa-way analysis of variance was used 
Vith five treatment conditions as one main effect and two levels of pretest 
as the other. Duncan's New Multiple Range Test was used to determine 
mean differences among the groups. Internal validity was controlled 
by random as^ment of S to the four programs. Since the programs 
were administ^ed to individual Ss, the basic experiment unit was S. 
The n-size for each condition was 10, total N=100. 

\ 

Subjects 
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The Instance probability analysis was conducted with 100 students 
enrolled in the undergraduate educational psychology classes at Brigham 
Young University. The additional lOO^^'in the experimental treatments 
were students from the same population. Ss were assigned randomly 
to the five programs. No Ss were droppecTfrom the investigation. 

Results ' ^ . " , 

Variable Measures 

Four error scores were obtained for each S*s responses on the 
(posttest according to the predicted responses on the dependent vari- 
ables (Table 2). S's responses were compared to the predicted depen- 
dent variables and were scored one error for each deviation.. Only the 
correct classification pattern was the correct ai\swer, the other tWee 
were based on predicted responses as the results of the manipulation 
of the three independent variables in the error producing conditions, 
i. e.*, overgeneralization, undergeneralization, and misconception. 
^Table 3 shows the treatment groups, represented by capital letters, 
and the,predicted errors for each dependent variable, e^ g. , the C 
group would make zero errors with the correct classification variable 
while O (overgeneralization) group would make eight, the U (under- 
generalization) group six,* and theJM (misconception) group wolild make 
nine errors. Thus each group was predicted to m'Ske significantly 
fewer errors than the other three conditions when its dependent vari- 
able was analyzed. c ^ 
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A two-way analysis of variance for each dependent variable main* 
effects of treatments and pretest versus no pretest, resulted in sig- 
nificance for the first effect (p<.Oi) and nonsignificance for the se^^ond 
(p>.05); the interaction was nonsignificant (p>.05). With the pretest 
versus no pretest no, difference, four univariate one-way analyses were 
run wAth the F^tests (4, 95 df): Classification, F=4.^8 (p<.01); Over 
generalization, F=3.39 (p^;;. 025); Undergeneralization, i^3.30 (p^^. 025); 
and Misconception,^ F=7.T8 (p<;. 01).* The posteriori that"used to Wter- " 
mine differences among the means for the four separate analyses was 
ljuhcan's New Multiple Range Tes^. The means for the four treatment 
groups according to the dependent variables are listedAn Table 3. 
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Corr ect Classification 
— 0 

Concept acquisition was hypothesized to result from an infinite 
concept class if the exemplars used in instruction were divergently 
paired in sets with matched nonexemplars. These conditions would 
provide the S with the behavior to generalize to previously unencounter- 
ed exemplars and discriminate nonexemplars. Ss receiving the 
correct classification program on crystals were predicted to identify 
all the RX2 crystals on the posttest without responding to other 
crystals as exemplars, i. e. , they would make zero errors on the 
posttest. The other conditions were hypothesized to makef significantly 
more errors (Table 3). On Duncan.'s NMRT, .the C group made fewer 
errors than the other groups .(p < 05). This corresponds to the 
hypothesis and the'predicted responses in Table 3. There were no 
any differences among groups 0, U, and M— slight differences were 
predicted >. 05). The pontrol group had significantly more errors 
than the experimental groups (£<. 01). ■ 

Overgeneralization > 

To promote a discrimination problem for concept acquisition it 
was hypothesized that unmatched exemplars/nonexemplars would pre- 
vent the $ from effectively using the negative instances because the 
irrelevant attributes would have no meaning. The S would not see a 
matching situation where the irrelevant attributes are the same with 
oply the relevant attributes removed.. If presented unmatched nonex- 
emplars, then the S will not discriminate between positive and negative 

^ instances when tested with previously ungncountered instances. On 
tiJie crystal posttest it was hypothesized that Ss receiving the over- 
generalization treatment" would identify more than any of the other 
groups. The means from the overgeneralization scoring pattern are 
different (Duncan's NMRT, 05). The O group did respond to more 
instances on the posttest which resulted in the fewest number of errors 
on the overgeneralization scoring pattern. The other experimental ^ 
groips,did not differ (£>. 05), from each ot\er., with the coUrol group 

■ being significantly diff^ent (£<:;. 01). ^ 

IJndergeneralization ^ " V (J 

^ To,pro4uce a condition in concept acquisition where the S can dis- 
• criminate negative instances, but cannot generalize, it was hypothesized 
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that under generalization would occur when using only high probability 
exemplars, ^ whether they were matched to nonexemplars or not. The S 
would be instructed with exemplars which had few important irrelevant 
attributes and when tested with previously unencountered instances 
which included low probability exemplars, the S would not identify them 
because of the increasingly complex irrelevant attributes, i. e. , the 
relevant attributes x^oultj not be as distinguishable because of the irrele- 
vant attributes. The U group, which received the above treatment, did , 
have fewer errors on the crystal identification posttest than the other 
groups (£< 05). A difference between of 14 points was predicted between 
the U and 0 groups. The difference of five points was significant at the 
. 01 level. The C group had fewer predicted errors than the O and M 
groups, and the mean error scores were different (p<. 05). The control 
group had the highest number of errors on the posttest (p<;. 05). 

Misconc'eption ^ 

Concept ^acquisition assumes that the S can generalize and dis- 
criminate foUowing an instructional situation. In the two error condi- 
tions reported above (overgeneralization and undergeneralizatioh), one 
or the other error was hypothesized to occur, Overgeneralization 
occurred because of unmatched exemplar s/non exemplars. ""And under- 
generalization resulted from using only high probability exemplars. A 
combination of these two errors would produce a misconception, i, e. , 
the S would neither generalize to ail previously unencountered exem- 
plars or discriminate all unencountered nonexemplars. A jnisconception 
error was hypothesized if Ss were presented convergent exemplars, 
similar irrelevant attributes, and unmatched nonexemplars, A range 
of probability was included in the hypothesis to account for low probabil- 
ity convergent exemplars. Since the S would receive exemplars with the 
saiftie irrelevant attributes, S would ass,ume ^ome of these to be relevant. 
Wnen seeing an exemplar without these irrelevant attributes, S would 
' not identify it. Likewise, upon .encountering a nonexemplar with the 
irrelevant attribute S assumes to be relevant, he would identify it* as 
an exemplar. In this investigation, the irrelevant attribute in which the 
S was hypothesized to accept as relevant was the black molecule. 
According to Duncan's NMR^, the M group differed from the other ex- 
perimental groups (£<01). There were no differences (£i>.05) among 
the other conditions, as predicted (Table 3), 

Discussion 

Th^relationship of instances in instructional environments seems 
to be a function of stimulus siitiilarity. This study investigated the 
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role Of positive and negative instances using a 'Veal" school subject to 

- rt .p!^if\^-^H ^^^(^ generalizable components. 

The results indicate that manipulation oV the three variables, probability 
fst'n ^"^,"L^.*^hing, can result in the behivioral er.oisTscuss! 
ed by Markle and Tiemann (1969). External validity of the variables » * 
IS strengthened because the results are similar to those of>f ennyson" . 
Woolley, and Merrill, (1971) and Tennyson and Merrill (191). . 

hPhu^i^'vf P?"^^"* variable, divergency, doling with, the relationship 
between exemplars according to-their irrelevant attributes was signi- 
iicant. The misconception group was instructed. with RXo crystals 
that a pronounced irrelevant attribute which the nonexemplrs did not 
and as a result identified on the posttest nonexemplars with that same 
irrelevant attribute as relevant. • The other treatment conditions re- 
ceived divergent exemplars and did not respond.to the irrelevant attri- 
bute when associated with a nonexemplar. Generalizafion within a con- 
cept class would seem to be a function of the divergency variable By 
instructing with very different exemplars, Ss transfer more readily 
when tested with previously unencountered exemplars. The correct 
classification and overgeneralization groups received a divergent ex- 
emplar and responded to the more^difficult RX2 crystal on the posttest. 
The difficulty of exemplars was determined by the instance probability 
analysis which subjectively and empirically rated the instances according 
to ease of recognition. ^ 

• 

Probability as an independent variable, is unique because instances 
can be rated on difficulty prior to constructing instruction. Individualiza- 
tion of instruction can make sequenencing of easy-to-difficult instances 
more attuned to the individual by feedback while in an instructional 
mode. Subjective rating of items has been the usual procedure in all -^'^ 
forms of instructional development. The instance probability analysis " 
A/i...?''''*j' approach to defining the levels of difficulty of the instances. 
As irrelevant attributes intensify, the difficulty of the instance increases 
Research as early as Bourne's (1957) has shown this linear relationship. ' 
Obtaming a subjective analysis on each instance and then constructing 
matched exemplar pairs with nonexemplarg is the first step in deciding * 
which instances to use in the instruction of an infinite concept class 
By combining the subjective analysis with a probability rating the ' 
sequencing of exemplar sets eliminates much. of the guess work iu oro- 
gram development. The mos.t significant difference obtained in this 
investigation was between the undergeneralization group and the ower- 
generalization group. An undergeneralization problem was hypothesized 
• when the S received only divergent high probability instances, so the S 
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would not transfer to low probability RX2 crystals on the posttest. The 
Ss receivine; this treatment made fewer responses on the posttest than 
any other group. On the contrary, it was hypothesized that the over- 
efeneralization problem, where the S would not discriminate previously 
tinencountered exemplars from nonexemplars, would be promoted by 
using divergent low probability instances of RX2 crysJ^s. Ss.in this 
treatment condition responded not only to exemplars hm to large numbers 
of nonexemplars, i.e. , they identifie^d more crystals as RX2 crystals 
than any other group. The use of the? probability variable alone did not 
cause this problem. Nonexemplars used in the instruction were un- 
matched with exemplars. 

The effect of the matching variable was shown by the increased 
response to nonexemplars by the overgeneralization group on the post- 
test. The nonexemplars were unmatched to the exemplars so that Ss 
failed to recognize the relevant attributes from the irrelevant attributes. 
When given difficult exemplars, the Ss did respond to the RX2 crystals 
on the-posttest, i.e. , they could generalize to new RX2 crystal instances, 
but they could not discriminate from crystals that were not RX2 crystals. 
The misconception group had an unmatched relationship between exem- 
plars and nonexempla-rs, and the Ss failed to distinguish between the 
relevant and irrelevant attributes of the RX2 crystals on the posttest. 
The result of the response patterns on the posttest show that the mis- 
conception group responded frequently to crystals having the irrelevant 
attribute of "black molecules," while not responding to other irrelevant 
attributes as the overgeneralization group. By using convergent exem- 
plar sets, the Ss focused on a common irrelevant attribute shared by 
all exemplars and assumed that to be relevant. 

Correct classification is a result of the interaction of the three 
independent variables investigated in this study. There is still some 
variance which cannot be explained, i.e. , the error mean score M the 
correct.classification group, while significantly lower than the other 
conditions, was still high. Further extensions of this study to account 
for the variance would include: sequencing of exemplar sets on a more 
individual basis, i. e. , a S might require more of fewer higli probability 
exemplars based upon personality differences (cf. , Tennyson and 
Woolley, 1971), individual probability ratings controlled by adaptive 
program on a CAI terminal; a more precise measure, of the matching 
variable; ar.a more instructional variables such as defining both relevant 
and irrelevant attributes. 
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Dependent Variable Outcome 
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Table 2 
Scoring Sheet 



Set #1 
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1. eg #6 
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2. eg #16 
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3. eg #3 
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4. eg #30 
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■"^ 5. eg #15 
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6. eg #12 
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7. eg #21 










8. eg #8 
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9. eg #17 




■ + 






10. ii'#4 

_ _ . 1 




+ 







Note. —Predicted responses according to conditions. M=misconcep- 
tion- 0= overgeneralization, U=undergeneralizatiou; ,C= correct classifi- 
cation; +tS indicates this sentence is a positivft instance; - =S indicates 
this sentence is a negative instance; ? =S could classify as eilher, no 
en'or possible ; eg indicates an exemplar; eg indicates a nonexemplar; 
# refei-js to original test item number. 
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Table 3 50 
Hypothesized Error Responses and Mean Error Scores 
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Treatment Conditions 


Control 

• 




: — rr 


c 


0 


. u 


M 




•iables 


Class. ' 


10. 55* 
0** 


13.25 
8 


13.35 

' 6 


14. 85 
9 


18. 10 


Dependent Vai 


Ov^r. 


10.05 
3 


8.00 
0 


10.05 
14 


9.95 
11 


13. -35 


Under. 


12.76 
6 


14. 75 
14 


9.15 
0 


* 

14. 75 
9 


17.30 




Mis. 


10.65 
9- 


li. 70 

11 


' W. 05 ' 
9 


7. 10 
0 


15.40 

• 



Note. --The treatment groups are represented by capital letters: 
C==Correct Classification; 0=Overgeneralization; U=Undergeneralization; 
and M=Misconception. 

♦First rows are the mean error scores. 
**Second rows are the predicted mean error scores. 




Figure 1 

The format of exemplar^onexem- 
plar presentation per page. 




Related Research and Development 

The present U. S. O. E. grant was profitable in generating extended 
investigations in concept acquisition. It therefore seems appropriate 
to include in this final report summaries of the published papers and 
abstracts of papers submitted to appropriate professional journals. 
The first study, Tennyson, WooUey .and Merrill (1971) was presented ' 
at the annual AERA Conference (1971). The reviewer for the Journal 
of Educational Psychology stated, 'This paper could prove to bea 
landmark study in educational psychology. " The procedures developed 
in that study in task construction were used in an aptitude treatment 
interaction study, Tennyson and WooUey (1971), which will apoear in 
the fall Journal of Educational Psychology , an.& will be preseiSed to 
the annual APA convention (1971) in division eight. Social and Personality 
Psychology. A paper summarizing the concept acquisition paradigm, 
WooUey and Tennyson's (1971), is soon to be published in Educational 
Technology . ~ 

The young researchers of the Brigham Young Univerjsities In- 
structional Research and Development center kept busy with the follow- 
ing studies. Tennyson (1971) investigated the effect of negative instances 
in instruction of classification behavior. ' This paper will be presented 
at the APA convention (1971). The ATI study was followed up by two " 
projects this spring. Boutwell and Tennyson (1971) were investigating 
anxiety .(^^ -time with task difficulties in a group presentation mode. 
To establish the predictive effect of aptitude and anxiety on task difficulty, 
Tennyson and Boutwell used a multivariate. multiple regression analysis. 
To define the methodology of the task variable of difficulty, Tennyson 
and Boutwell (1971.) wrote a paper on the Instance Probability Analysis ' 
(to be published in AV Communications Review ). 

The Instructional Research & Development center is continuing it's 
research in the field of what Glaser (1967) calls "school related" topics. 
The dissemination activity is also going with a home study course by 
Robert Tennyson on 'Concept Learning. " A book which will expand 
this course is being currently written by Tennyson and Merrill. 

Additional Papers Paper 

Exemplar and nonexemplar variables which^roduce 9 
correct concept classification behavior and specified 
classification errors. 
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Instructional variables which predict specified learner 
concept acquisition and errors. 

Interaction of anxiety ^th performance on two levels 10 
of task difficulty 



Conceptual model of classification behavior. 
Instance probability analysis 
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EXEMPLAR AND NONEXEMPLAR VARIABLES WJHICH 

PRODUCE Correct concept classification 

BEHAVIOR AND SjPEClFIED CLASSIFICATION ERRORS 

Robert D. Tennyson . . , F. Ross Woolley 

and M. David Merrill 
Brigham Young University. 

ABSTRACT 

Working from a theoretical model, thr6e independent variables 
were manipulated to (produce four predicted dependent variables. The 
first variable is the relationship be^A^een exemplars and nonexemplars. 
A matched relationship exists between exemplars and nonexemplars 
when the irrelevant attributes are as similar as possible. The differ- 
ence between the t>vo being the relevant attribute(s). An unmatched 
relationship exists between an exemplar and a nonexemplar when the 
irrelevant and relevant attributes are different. The second independ- 
ent variable is the probability rating of exemplars and nonexemplars. 
High probability exemplar s/iionexeniplars are those which are correctly 
classified by a majority of a population when ^'iven only a definition 
identifying the relevant, attributes. Low probability exemplars/^fcnex- 
emplars are those which are not classified correctly by a majority of • 
a population. The third variable is the relationship of exemplars with " 
other exemplars. This relationship is based on the similarity of ir- 
relevant attributes. Two values are used here: divergent, the irrele- 
vant attributes are as different as possible; and convergent, the 
irrelevant attributes are as similar as possibfec^ ~ 

The three independent variables were conabined to predict four 
dependent variables. The manipulation of the independent variables 
is based on frequency distribution assumptions and the possible com- 
binations of the independent variables. The dependent variable of 
correct classification is hypothesized to occur when exemplar s/ponex- 
emplars are matched, when high and low probability exemplar s/nonex- 
emplars are used, and when the exemplars are divergent. Overgener- 
alization is hypothesized to occur when divergent low probability 
exemplars are unmatched with nonexemplars. Undergeneralization 
is hypothesized to occur when only divergent high probability, matched 
exemplar s/nonexeftiplars are used. And finally, misconception is 
hypothesized when convergent high and low probability exemplars are 
unmatched with exemplars. 
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An empirical task analysis procedure was used to obtain the proba- 
bility ratings on the exemplars/dionexempiars. The self-instructional • 
programs for each of the four treatment conditions followed one format 
display. The Ss began the program with a definition of trochaic meter. 
The foijmat qf the exemplar/nonexemplar displays consisted of eight 
pairs of poetry— two exemplar and two nonexemplar per page. The 
instances were labeled as exemplar or nonexemplar. Four programs 
were constructed using the values of the independent variables speci- 
fied above. The S proceeded to the exam without interruption. The 
criterion test was constructed so that the predicted responses of the de- 
pendent variables could be analyzed, not by mean error scores, but 
by prearranged predicted response patterns based on each dependent 
variable (Table 1). ♦S was scored with an error for a given dependent 
variable when his response to an item differed from the predicted 
response. This procedure gave the S a score for each of the four hypo- 
thesized dependent variables (Table I). Internal validity, was controlled 
by random assignment of Ss to the four programs. The undergraduate 
BYU student was the basic experimental'unit. The n-size for each 
treatment was 19, total N=76. v 



. Insert Table 1 about here 



analysis of covariance was utilized to test mean significance 
with S'JSj GPA as the covariate. The means for the four treatment 
groups are listed in Table 1. There was a significant difference between 
means for all four treatments, £<. 01. Correct classification: On the 
Newman-Keuls Sequential Test and Duncan's New Multiple Range Test 
at the correct classification (C) group njade significantly Jewer errors 
than the other three gr'oiqps. The other relationships hypothesized 
were significant either at . 01 or . 05. Overgeneralization: The Newman- 
Keuls showed a significant difference at . 01 between the overgenerali- 
zation (O) group and the undergeneralization (U) group. A difference 
significant at the . 05 existed between O group and misconception (M) 
and C groups on the Newman-Keuls. Duncan at . 01 shows a difference 
for O with U and M groups, and a . pS existed for O group and-C groip . 
Undergeneralization:. The multiple comparisons of the undergenerali- 
zation error scores are significant at . 01 that the U groip differed 
from the 0 and M groups.- There was a . 01 between C and U on the 
correct classification analysis, but here, the difference was only at 
the . 05 on both tests. The other predicted differences are significant 
in all cases at the . 01 level. Misconception: The results followed the 
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predicted variables on all factors at . 01 significance. The M group 
>^as significantly different from 0, .U, and G groups. 

Precise independent variables were arranged in such a way that 
predicte.d dependent varia^5ies resulted in all cases. The most signi- 
ficant differencejDbtalned in this study was between the undergenerali- 
zation and overgeneralization groups. The undergeneralization group 
was presented only high probability exemplars and, as a result, re- 
sponded to few items on the test. On the contrary, the overgeneralization 
groip received only low probability exemplars and responded to 
practically everything on the test, The independent variable of match- 
ed exemplars/nonexemplars can be seen empricially on the increased 
response to nonexempiars by the overgeneralization and misconception 
groups. The implication is that discrimination is more effectively 
taught if the matching of exempjars/^ionexemplars is empirically con- 
trolled by a task analysis probability rating of both exemplars/nonex- 
emplars. The independent variable of relationship between exemplars 
with other exemplars according to their irrelevant attributes was 
significant. The thrqe treatments of classification, undergeneralization, 
and overgeneralization all received divergent exemplars. Only the 
misconception group received convergent exemplars. 

More worjc is needed on different subject matter tasks and sample 
popluations to add external validity to the results gained here. Further ' 
research will expand the variables and implications obtained in this' 
study. 



I 



■ , TABLE 1 

Mean Scores of the Four Dependent Variables 





Means 




Groups 


C 


0 


U 


M 


\ 

CU rH 

G a 


Class. 

Over. 

Und. 


0* 

5.685 

8* 
9.014 

6* 

8.553 


8* 
12.970 

0* 

7.002 

. 14* 
14.334 ■ 


6* 
9.836 

•14* 
11.832 

0* 
6.221 


9* 
11. 980 

11* 
9.255 

9* 

11. 627 




. Mis. 


9* 
0 9. 809 


11* 
10.521 


1 9* 
9.759 


0* 
7.382 



♦Predicted Errors 
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INSTRUCTIONAL VARIABLES WmCH PREDICT SPECIFIED 
LEARNER CONCEPT ACQUISITION AND ERRORS 

Robert D, Teniiyson 

In a study by Tennyson, Woolley, and Merrill (1971) independent 
variables were found that produced predicted correct classification and 
specified errors. Mechner (1965) defined concept acqidsition as the 
ability to generalize witliin a class and discriminate between classes. 
He maintained that in order to assess concept acquisition, both exem- 
plars and nonexemplars must be presented. In the Tennyson et al. 
study, correct classification behavior resulted from exemplars which 
differed widely in the irrelevant attributes, and nonexemplars which 
had irrelevant attributes resembling those associated with given 
exemplars. When those conditions were not met, three classification 
errors resulted: overgeneralization, undergeneralization, and mis- 
conception (c. f. , Markle and Tiemann, 1969). 

Controversy has resulted in concept reseai^ch concerning the value 
of negative instances (nonexemplars) and their relationship to positive 
instances (exemplars) in promoting concept acquisition. Smoke (1933) 
concluded that negative instances were of no value in concept learning, 
Morrisett and Hovland (1959), in replication of Adams' (1954) study of 
single task vs. multiple task, found that a variety of positive instances 
was necessary to effect a transfer of concept learning. In studies of 
combined instances, the equivalent attributes of positive and negative 
^ '-'ances are found to be poorly utilized by human subjects, (Bruner, 
v.jodnow, and Austin, 1956; Donaldson, 1959; Hovland and Weiss, 195C). 

Independent Variables 

Based on the theoretical work of Merrill (1971), Markle and Tiemann 
(1969), Woolley and Tennyson C1971) and the research of Tennyson, 
Woolley, and Merrill (1971), four independent variables were investigat- 
•ed in this study: 1) Probability: All exemplars and nonexemplars used 
-in instruction are presented to a sample of Ss to determine probability. 
The Ss receive a definition (relevant attributes) of the concept class 
prior to classifying the instances. , High probability. items are those in- 
stances correctly identified by 60% or more of the sample. Low 
probability are those instances correctly classified by less than 40% of 
the sample. 2) Matching: An exemplar and nonexemp.lar are matched 
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when the irrelevant attributes of the two are as similar as possible. 
An unmatched relationship between exemplar and nonexemplar occurs 
when the irrelevant attributes of the two are as different as possible. 
3) Divergency: Two exemplars are divergent when the irrelevant 
attributes of the exemplars are as different as possible. This relation- 
ship assumes the same probability level. A convergent relationship 
occurs when the irrelevant attributes are as similar as possible, 4) 
Nonexemplars: The relationship of exemplars/nonexemplars presenta- 
tion is contrasted with exemplars-only presentation. 

Hypothesis 

The four variables were combined in various logical groupings to 
predict four dependent variable outcomes. The in(Jependent variables 
refer to characteristics of exemplars presented to S along with a de- 
finition. The predicted S response patternis were measured using 
additional unencountered exemplars and nonexemplars which the S was 
asked to classify without confirmation. Two experiments were con- 
ducted. Experiment one used nonexemplars in all treatments and the 
second experiment did not use nonexemplars in all treatments. The 
hypotheses are summs^rized in the following statement:^: 

1) If instances represent a range of probability and exemplars are 
matched to nonexemplars and are divergent with each other, then Ss ^ 
will correctly classify previously unencountered instances. 

lA) If only exemplars are used,^ the Ss will tend to overgeneralize 
when classifying previously unencountered instances. 

2) If instances are low probability, exemplars are not matched to 
nonexemplars, and exemplars are divergent with each other, then Ss 
will tend to overgeneralize when classifying previously unencountered 
instances. 

2A) If only exemplars are used, the Ss will tend to overgeneralize 
when classifying previously unencountered instances. 

3) If instances are high probability, exemplars are matched to non 
exemplars, and exemplars are divergent with each other, then Ss will 
tend to undergeneralize when classifying pre\dously utiencountered in- 
stances. 
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4) If instances represent a range of probability, exemplars are 

' not matched to nonexemplars and exemplars are convergent with each 
other, then Ss will tend to demonstrate a misconception when classify- 
ing new unencountered instances. 

t 

4A) If only exemplars are used, the Ss will tend to demonstrate . 
a misconception v;hen classifying new "unencountered instances. 

.f 

5) ir instances represent a range of probability, exemplars are 
not mate he'd to nonexemplars, and exemplars ^_re divergent with each 
other, then Ss will tend to overgeneralize When qlassifying previously 
unencountered instances. 

5A) If only exemplars are used, the Ss will tend to overgeneralize 
when classifying previously unencountered instances. 

6) If instances are high probability, exemplars are not matched 
to nonexemplars, and exemplars are divergent with each other, the Ss 
will tend to undergeneralize when classifying previously unentountered 
instances. >~ ' - , • 

' 6A) If only exemplars are uSed, the Ss will tend to undergeneralize 
when classifying 'previously unencountered. instances. 

Method 

Subjects 

Ss were seventh grade students from tlTree Utah school districts: 
Alpine, Provo, and Nebo. Each district provided an alphabetical list 
of all students from which the Ss were randomly selected. 

Task • 

The grammatical concept of adverbs was used as the task because 
it is generally used in school English curriculum, and because the ir- 
relevant attributes of this concept are infinite. An instance probability 
analysis consisting of 120 sentences was conducted to determine pro- 
bability ratings for each instance. 

Proce dure 

The programs for the twelve 'treatments (Experiment 1) used the 



Tennyson 62 

same format display. After reading the general direction s,the Ss 
turned to page 1 and began the self-instructional program. All treat- 
ment programs included a pretest on nouns. Half the Ss in each group 
received in addition a pretest on adverbs. The .directions consisted of 
a ^hort definition of adverbs and method of classifying. The formaf 
of the exemplar/nonexemplar displays consisted of eight pairs of 
sentences-^tVr'o exemplars and two nonexemplars per page. The instances 
were.labeled as ^'example'* and ''not an example.'' Adverbs were under- 
lined and modification was shown by an arrow. 

For experiment twd the nonexemplars were removed from the 
programs used in experiment one. The control group received the pre- 
test and the.ppsttest, the irrelevant task being poetry. 

The S proceeded to the posttest without interruption. The criterion 
test was constructed so that the predicted responses of the dependent 
variables could be analyzed, not by mean error scores, but by prearrang- 
.ed predicted resporise patterns based on each dependent variable. S 
was scored with an error for a given dependent variable when his re- 
sponse to an item differed from the predicted response. This procedure 
gave the S a score for each of the foui* hypothesized dependent variables. 

Experimental Design 

A Solomon Four design was used, i.e., for each treatment half the 
Ss received a pretest. To control the, error variance due to the hetero- 
geneity of the Ss, a covariate pi^etest was used. 

Results 

An analysis of covariance was utilized to test mean significance 
with S's scores on the noun pretest as the covariate. There was a 
difference between means for all twelve treatments (£< 01) in experi- 
ment one. . No difference resulted between the pretest (adverbs) and un- 
pretest groups (£>. 05). Correct classification: On the Newman-Keuls 
Sequential Test and Duncan's New Multiple Range Test, the correct 
classification (C) group made fewer errors than the other six groi5)s 

01). The other relationships hypothesized were either £<. 91 or 
£<. 05. Overgeneralization: The Newman-Keuls showed a difference 
between the overgeneralization(O) group and the undergeneralization 
(U) group (p<. 01). Other differences were between O groups and mis- . 
conception (M) and C groups (p<. 05). Duncan had similar differences 
for 0 group and C group (p<. 05). Undergeneralization: the multiple 
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comparisons of the undergeneralization error scales showed a 
difference between U group and 0 and M groups 01). There was s 
.01 between C and p on the correct classification aijalysis, but here, 
the difference was only at the .05 on both tests. The other predicted 
differences are significant in all cases at the .01 level. Misconception: 
the results followed the predicted variables on all ^^ctors (g<. 01). 
The M group was different from 0, U, and C groups. In experiment 
two there was no difference between groups' (p<. 05). 

Discussion 

Precise independent variables were arranged in such a way that 
predicted dependent variables resulted in all cases. The most significant, 
difference obtained in this study was between the undergeneralization and 
the overgeneralization groups. The undergeneralization group was pre- 
sented only high probability exemplars and, as a result, responded to 
few items on the test. On the contrai'y, the overgeneralization group 
received only low probability exemplars and responded to practically 
everything on the test. The independent variable of matched exemplars/ 
nonexemplars can be seen empirically by the increased response to < 
nonexemplars by the overgeneralization and misconception groups. The 
implication is that discrimination is more effectively taught if the match- 
ing of exemplars/nonexemplars is empirically controlled by a task 
analysis probability rating o.f both exemplars/nonexemplars. The inde- 
pendent variable of relationship between exemplars with other exemplars 
according to their irrelevant attributes was significant. The three 
treatments of classification, undergeneralization, and overgeneralization 
all received divergent exemplars. Only the misconception group received 
convergent exemplars. The fourth variable of exemplar/nonexemplar 
presentation is unique since the predicted S response patterns did not 
result when nonexemplars were excluded. Ss in this treatment condition 
responded randomly on the posttest, similarly to the control group. 
Wlien contrasted to the finding in experiment one, the exclusion of non- 
exemplars in instruction can result in a fourth classification behavior 
error or random responses. 

More work is needed on different subject matter tasks and sa|iple 
populations to add external validity to the results gained here., Fifrther 
research will expand the variables and implications obtained in this study. 
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INTERACTION .OF AKXIETY WITH PERFORMANCE 
ON TWO LEVELS OF TASK DIFFICULTY 

i 

. Robert D. Tennyson F. Ross Woolley 

Florida State University Brigham Young University 

■3 

Empirical data on the interaction of emotional effects with the 
cognitive effects of instruction is minimal. In a study by O'Neil, 
Spielberger, and Hansen (1969) the anxiety state of subjects involved 
in' a self-instruQtional learning task was significantly related to the 
difficulty of the subject matter. Their study, with tightly controlled 
internal validity, was an investigation of Spielberger 's (1969) assump- 
tion that state anxiety (A -State) differs from trait anxiety fT-State). 
A -State environmental conditions fluctuate while T-State is the variable 
related to the more stable anxiety individuals. The study by O'Neil 
et al . also investigated the Spence (1958)-Taylor (1956) drive theory 
that high A-State persons would commit n^ore errors on a difficult task 
^ than low A -State persons, but this situation would reverse on an easy 
"task. The O'Neil et al . study in part confirmed this assumption when 
the Ss did increase. in anxiety during the difficult task. The study show- 
ed an error reverse interaction within the difficult ta,sk. 

Independent Variable 

This study investigated the independent variable of task difficulty 
in connection with the interaction of individual anxiety states and in- 
structional treatment. The independent variable included two levels of 
difficulty, an easy and a difficult task. An easy task was defined as one 
in which the displayed exemplars (positive instances) and nonexemplars 
(negative instances) were of high probability- -a majority of a given 
population when given the definition (list of relevant attributes) can 
classify the previously unencountered items as members of a giv.en 
class. The difficult task was defined as one composed of low probabilii,y 
exempUirs and nonexemplars --defined as those previously unencountered 
instances which a majority of a given population when given the de- 
finition cannot classify correctly. 

Hypotheses 

The dependent variable was the S's error rate recorded for each 
level of the S's A-State. Ss with a low measured A-State were hypothe- 
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sized to make fewer errors on the difficult task than Ss with a Mgh 
measured A-State. Conversely, high A-State Ss were hypothesized to 
make fewer errors on the easy task than low A-State Ss. Thirdly, S's 
measured A-State score was hypothesized to increase following the 
difficult task and ^o decrease with the easy task. Thus, the study 
hypothesizes that a disqrdinal interaction exists between task difficulty 
and the S state anxiety. 

Method 



Subjects * 

The in.<?tance probability analysis was conducted with 35 stude^its en- 
rolled in an undergraduate educational psychology class at Brighara 
Young University (BYU). The program sessions involved 29 randomly 
selected BYU undergijaduate general psychology students (12 males and 
17 females). 

Task 

The self-iristructionai program for this study was concept acquisi- 
tion. The concept's relevant attribute was poetic trocliaic meter. An 
instance probability analysis involving 85 pieces of poetry was conducted 
to determine correct classification probability ratings for each piece of 
poetry. The Ss studied a definition of trochaic meter and then identified 
each poetic selection as either an example or not an example, A frequency 
distribution of correct classifications resulted which resembled a normal 
one-tailed curve. High probability selections were those correctly de- 
fined by the Ss at a frequency of 60% level and above; low probability 
selections were identified at 40% level for exemplars and at 50% level 
for nonexemplars. The task was composed of two parts: a difficult 
section of poetry selections, and an easy section of poetry selections. 

Anxiety Measures 

The %)ielberger, Gorsuch and Lushene^<1969) State-Trait Anxiety 
Inventory (STAI) was used to measure A-T?ait and A-State. The A- 
Trait (Form X-2) SCale asks Ss to indicate how they ''generally feel", 
whi?.e the A-State (Form X-1) "Scale requires Ss to indicate how they 
feel *'at this moment. Systolic blood pressure (SEP) was taken using 
a blood pressure cuff (sphygomomanometer) and stethescope. 

Experimental Design 
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This study utilized a multiple treatment experimental design 
(Campbell and Stanley, 1963), Tliree Es worked with a maximum of 
eight Ss per session. A session consisted of four periods in which the 
SBP and STAI A- State Scale were administered. . 

Procedure 

, During the pretask period each S took the STAI A-Trait Scale 
follov/ed by the STAI A -State Scale and the SBP. The S was then given 
directions' and the definition. The second period was the difficult task 
followed by the SBP and the STA I A-State Scale. In the third period 
the S again received general directions and proceeded with the easy 
task followed by the SBP and the STAI A-State Scale. During the fourth 
period the S was alone for three, minutes. The SBP was taken and the 
STAI A-State Scale was administered a fourth time. 

Results , 

Tlie depen<ilent x^ariabie measures were STAI A-State Scale and 
A-Trait Scale scores, SBP readings, and task errors. The STAI A-Trait 
Scale score was correlated . 44 with the second (difficult period) STAI 
A-State Scale score. An r pf , 62 was calculated between STAI A-Trait 
Scale and the third measure (easy period) of STAI A-State Scale score. 
S,^ were separated into low and high anxiety by the median score of 39 
on the first STAI A- St^' Scale. There was a correlation of ; 92 between 
the Ss initial classification on anxiety level and his classification on 
second (difficult) and tliird (easy) STAI A-State Scales. 

Ap analysis of variance of repeated measures was used with a 
Newman-Keuls Sequential Test to obtain significant differences of STAI 
A-State Scale means. There was a difference between anxiety periods 
(F=6.-58, df=3/84, p<.01). The STAI A-State Scale scores increased 
from the pretask period to the difficult task and decreased following the 
easy task with no change witliin the posttask period. The mean differences 
were between the difficult period and the other period (g<. 01), bat there 
were no differences between the pretask and easy task or posttask (2.>.p5). 
Blood pressure readings did not vary from period to period (F=l 07 df= ' 
3/84, p>.05). • . ' 

A two-factor lesign was used to analyze the interactfon. Task treat- 
ment, at two levels, was administered to all Ss, while the anxiety effect 
was controlled with two different groups, "^or the main effect^, there 
were no differences (£>. Q5) for either the Between-Ss on anxiety or the 
Within-Ss on task difficulty; however, the interaction was (F=ll. 26, df= 
1, 28, £<• 01). The error means were plotted according to anxiety 
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groups and task difficulty (Figure 1). To test for differences between 
the means withing the anxiety level, the Least Significant Difference 
(LSD) iest was uSed because of its decreased probability of making a 
Type n error. The low A-State group differed between tas^s (p^.05). 
A difference was found "between the mean errors of the tasks for thi 
high A-State group (p<.05). The low A-State group made fewer errors 
on the difficult- task Ehan the high A-State group (p<. 05). The disordinal 
interaction was complete with the high A-State group making fewer 
errors on the easy task than the low A-State group (p<.05). To check 
t the results-bf the LSD test, an Individual Degree of Freedom test was • 
included; the -results were similar (p<^. 05). 
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Discussion 

The disordinal interaction of measured high anxiety individuals 
with low anxiety individuals on the two levels oT task difficulty follows 
the assumptions of the Spence-Taylor drive theory. • Since the data 
did result in a significant disordinal interaction, several implications 
for instruction are evident. Individuals who do have anxiety increases 
during difficult tasks might be expected to perform more efficiently 
if they receive instruction geared for slower increases of difficulty. 
The opposite expectation would be indicated for low state anxiety in- 
dividuals. For these individuals, to be instructed with an easy task 
would produce a less effective means of learning. The disordinal 
interaction of state a,nxiety and instructional complexity cannot be 
ignored in instructiona,l systems. 



Tennyson Woolley 
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Appendix A Introduction Used In All Programs 



Dear Student: 

• * 

You have been randomly selected from all educational psychology 
students to participate .in a research grant funded by the United States 
Office of Education. The instru^ctions you are to receive have been 
developed to attain 'specific information. Please follow all directions 
carefully* \\ 

■ \ ■ , 

This program is designed to tte self -instructional. The experiment- 
er cannot answer any questions. If for some reason you cannot continue 
with the program, please take the prpgram to the experimenter and 
leave quietly. There are no timed breaks, so once you begin, continue 
until finished. 



When you have finished reading the above, please continue Lo the next 
page. 



ERIC 
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Appendix A- 1 Pretest Used in Groups I, 3, 5, ... ^ 17 



The next few pages will contain selections of poetry which 
you are to identify as either being- examples of trochaic meter or 
not an example of trochaic meter. This is a pretest and it is used to 
determine your knowledge of trociiaic meter before you are given 
instructions We assuijie that most students are not familiar with 
trochaic meter. 

After reading each selection, you are td- respond by writing 
"yes" opppsite the correct number if an example, or "no" if not 
an example. 



When you have finished reading the above, please continue to the 
ne. I page. 
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PRETEST 



1. Now the day is over 

Night is drawing nigh 
Shadows of the evening 
Steal across the sky. 

(Sabine Baring-Gould) 

» 

2. Take thought: 

I have weathered the storm 
I have beaten out my exile. 
(Pound) 

3. Through the noises of the night 
She floated down to Camelot: 

(Tennyson) 

4. Sure solacer of human cares, 

And sweeter hope, when hope despairs! 
(Bronte) 

5. From ghoulies and ghosties 
Go out ghasfly grumblings. 

(Anonymous) 

6. And we just made it out of the Big Muddy 
With the captain dead and gone. 

(Seeger) 

7. "Danish ships of war at seal We have 
sighted fifty -thr eel " 

(Tennyson) 

8. Says he, ''Dear James, to murder me 

Were a foolish thing to do,' 
For don't you see that you can't cook me. 
While I can-- and will— cook youl '* 
(Gilbert) 

9. I don't know why she didn't like my saying 
that. She gave me her plaintive smile and her 
beautiful eyes filled with tears. 

(Maugham) 

After you have answered all of the above questions, continue to the 
next page. 
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10. Glory be to God for dappled things 

(Hopkins) 

11. Yet, as if grieving to efface 
All vestige of the human race, 

On that lone shore loud moans the sea, 
But non, alas ! shall mourn for me ! 
( (Wilde) 

, 12, The God of love my Shepherd is, 
And He that doth me feed, 
While He is mine, and I am His, 
What can I want or need? 

(Herbert) 

13. Have I not passed thee on the wooden bridge 

Wrapt in thy cloak and battling with the snow. 
They face toward Hinksey and its wintery ridge? 
(unknown) 

14. Could I but live again 
Twice my life over. 
Would I not strive again? 

(Browning) 

15. He says we are beggars. 

(Randal^ 

16. Oh, to be in England 
Now that April's there. 

(Browning) 

17. Wild Spirit, which art moving everywhere; 
Destroyer and preserver; hear, O, hear! 

(Shelley) 

18. When they shot Malcolm Little down 
On the stage of the Audubon Ballroom, 
When his life ran out through' bullet holes 

(Like the people running out when the murder began) 
His blood soaked the floor. 

(Patterson) 

After you have answered all of the above questions, continue to the 
next page. 
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19. 
20. 

21. 
22. 
23. 

24. 

25. 

26. 
27. 

<i 
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A crack war. in the glass 
- (unknown) 

Since I can'never see your face, 
And never shake you by the hand, 
I send nly soul through times and space 
To greet you. You will understand. 
(Flecker) 

« 

The readers of the Boston Evening Transcript 
Sway in the wind like a field of ripe coi;*n. 
(Eliot) 

Take her up teftderly, 

Lift her with care; ^ 
(Hood) 

But the wind can so easily whip 

The still water-to foam, 
And the harmless bay "waves turn 

To storming gray bpulders that pound, 
(unknown) 

Memory tells me of the many .times 
We were three in a room, trapped 
By the all -constricting walls of a 
summer shower. 
(Lee) 

He says we are beggars and I say 
When it comes to love we are orphans 
We are all misplaced or displaced 
Persons from another war. 
(Randall) 

Tasks in hours of insight willed 
Can be through hours of gloom fulfilled. 
(Arnold) 

Soft and easy is thy cradle 
Coarse and hard thy Savior lay. 
(unknown) 

After you have answered the above questions continue to the next 
page. . 



28. My mind to me a kingdom is, 
Such present joys therein I find. 

(Dyer) \ 

29. When the breakers are roaring like beasts on the floor 

of the Bourse, 

And the poor have the sufferings to which they are 

fairly accustomed, 
And each in the cell of himself is almost convinced 

of his freedom; 
A few thousand will think of this day. 
(Auden) 

30. The wine of life keeps oozing drop by drop. 
' . (Fitzgerald) 



After you have answered all of the above questions, continue to the 
next page. 
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Appendix A- 2 Introduction to Trochaic Meter Program Used in 
all Groups Except 9, 10, 11, 12, 17, 18. 



The following pages will present to you a program to teach 
the concept of trochaic meter. The programs vary in length 
'according to a random selection. Study each program carefully. 



\ 



When you have finished reading the above, please continue to the 
next page. 
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Appendix A -3 Definition Presentation Used In All Gro^is Except 9, 



Part of the rhythm of a poem is determined by the time between 
stresses being occupied with unstressed syllables or pauses. Denoting 
the stress patterns is to establish the meter. One of the major meter 
scansions is named trochee aJid consists of a stressed syllable follow- 
ed by an unstressed syllable (marked thusly:/ty). 



When you have finished studying the above, please continue to the next 
page. 



10, 11, 12, 17, 18. 



* 
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Appendix A-4 Attribute Definition Used In Groups 3, 4, 7, 8, 15, 16. 

Words are composed of at least one syllable. Each syllable con- 
stitutes an elemen ary sound (diphthong) produced by a single impulse 
of utterance and constitutes the word or a part of the word. Adjoining 
syllables in a word or phrase are marked by abatements, renewals, 
or reinforcements of the stress so that there is the feeling of separate 
impulses. 

Lang^aage patterns have established the pronunciation of words. 
The syllables are inherent in the language and vary only slightly with 
varying dialects. Some syllables, such as ing, are generally unstress- 
ed or soft. Other syllables, such as pro, are generally stressed 
(given more emphasis when verbalizing). These naturally stress, un- 
stress syllables comjDine to give variety to language. Poetry carefully 
uses patterns that can result when words are grouped according to the 
stressed and unstressed syllables. For example, a line of words that 
follows this pattern: stress, unstress, stress, unstress; gives a dif- 
ferent effect than this pattern: slress, stress, unstress, stress, 
stress, unstress. 

Each of the pattern possibilities have been named for reference. 
And stressed syllables are marked with a diagonal line above the syll- 
able (eg. dant ing). Unstressed syllables have been given a small 
arc marking (eg. danc ing). The marks are placed directly above the 
referent syllable. This program will deal with just one pattern used 
in poetry: Trochee (marked thusly:/u). It consists of a stressed 
•syllable followed by an unstressed syllable. 

Trochaic meter produces a more powerful effect than most other 
meters. It can convey boredom, frustration, supernatural, or anger 
because it starts with a strong beat and it is short. The chants of the 
American Indians were often set to trochee. The reader must deter- 
mine, in any poem, which syllables are to be stressed. 
'-•> 

The trochaic line often finishes with a strong beat--a masculine 
ending. Poets generally avoid sustained trochaic measure because of 
the tendency for it to become monotonous. Children generally enjoy 
the beat, however, and it is often used in short songs. 



When you have finished studying the above, please continue to the next 
page. 
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^ Appendix A -5 Exemplars -Nonexemplars Presentation Used in Groups 
5, 6, 7, 8, 9, 10 11, 12, 



Example: 



Not an Example: 



Example: 
Not an Example: 
Pxampl 

I 



Not im Example: 



Example: 



Out of childhood into manhood 
Now had grown my Hiawatha. 

(Longfellow) 

Come to the crag where the beacon is 
blazing, 

Come with the buckler, the lance, and 
the bow. 

(Scott) 

Pansies, lilies, kingcups, daisies. 

(Wordsworth) 

Motherly, Fatherly, Sisterly, Brotherly! 
(unknown) 

Lay a garland on my hearse of the dismal 

dew ^ 
Maidens, willow branches bear, say I died 

true. 

My love was false, but I was firm from my 

houx'' of birth; 
Upon my buried body'lay lightly, gently, 

earth. 

(Fletcher) 

Nor marble, nor the gilded monuments 
of princes, shall outlive this powerful rime; 
But you shall shine more bright in these 
contents 

Than linswept stone, besmeared with 
sluttish time. 

(Shakespeare) 

We stripped and dived and found his body 
Stuck in the old quicksand. 

(Seeger) 



Wlien you have finished studying the above, please continue to the next 
page, 
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Not an Example: 



Example: 



Not an Exampl e: 



Example: 



And we just made it out of the Big 
Muddy 

With the captain dead and gone. 
(Seeger) 

There are they, my fifty men and 
women 

Naming me the fifty poems unfinished! 

(R, Browning) , , 

'Tis hard to say if greater want of 
skill 

Appear in writing or in judging ill, 
(Pope) 

Boys in sporadic, tenacious droves 
Come with sticks, as certainly as 
Autumn, / 

• (Ebdrhart) 



Not an Exampl e: 
Example: 



My mind to me a kingdom is. 

Such present jovs therein I find, 
*(Dyer)' 

I want to know 
what is really 
going on, 

(Resendez) 



Not an Example: 



Example: 



Not an Example: 



Alone, alas. 
He sat. 



(unknown) 



I will go up to the mountain 
And there I will, light a fire. 

(Aust in) 

My mind to me a kingdom is 
Such present joys therein I find, 
(Dyer) 



When you have finished studying the above, t)lease continue to the 
next page. 
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Appendix A -7 Nonrelevant Task Used in Groups 17, 18, 

The (TV loday is for instant improvement of the schools, ai.d 
there \>7 prebsurr for wholesale dib.-^eminition and development activities 
wahuul the nerehsary prior research. The educator from the field in- 
vanabl\ asks fhe university to help him \vith today's problems, and 
thai IS understandable. It is understandable, but more deplorable, 
thiit Conj^ress spasmodically Kshes out with crisis oriented legislation 
b it IS unsympalht*lic to balanced, across-the-board, long-range plans. 
It is traj;ic that in the U.S. Office of Education the Bureau of Research 
has thrown its foi-ccs heavily on the side of '^practical products*' and 
dis.semination. While the USOE is a passive patron of basic research, 
it has done nothin;^ lo formulate and sell to Congress a policy that will 
promote the healthy development of basic investigation. 

* 

What the IISOE views as research is well illustrated by an early 
i^^66 press release in which it reports enthusiastically on the use of 
electronically c(unpressed speech to teach the blind, the teaching of 
firsl-s[raders bv tape recorders, and teaching third-graders to sir^ 
midieval plainsong. .Sume ad hoc novelties such as these have practical 
value, cuid they deserve a triaji. But the research program ought to 
ha\t:' the hiijher objective of reexamining oducalional ideas and the 
underlying of mental devehtp/iient is true, and what does it imply for 
t ducaiors? Hnw can we ac count for growth in ability to form elaborate 
stMitence structures? How doe^ motivation for achievement develop? 
What part does personal identification with the teacher play ni^formmg 
character and interest? And so on. 

Massive dissemination encourages faddism in education. WOiat 
biiund^ like a good idea is launched nationwide long before it has been 
deterniined that the methcjds asi d are reallv suitable. There is nc» 
evi(ipu( e to ^astily. for example, the California legislation that re - 
yuiPLs in.struciu»n in foreii>n language in grades six lo eight, the assump-* 
ti Mis u^ecl to justily the requirements are untested and with the law now 
a fai* .tccompli. no one is about to test Ihem. The energies of the 
pcMjjle who miijM be givinu thoughtful attention to language instruction 
are diverted int(* a crash program to write curriculum materials and 
*r,nn teijchcrs The Head Start program is easier to justify, since it 
iM'flei a na!io»tal acceptance of responsibility f(*r the disadvanlaued 
child, and one cannot waste a generation <»t. children while wailinu lor 
leseaich. Bi:' psvcholugisls do not know whether anv of the interventnm 
|ir«»grams nnw i ei:iu mstalk'd can produc-e lasting benefit to mtelhuiual 
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develupnu ni : th(» pinurnis tlitler bu radically u\ their usbumptiohs * 
ih'iV v/e ran alnmsi be certain that some of Lhem are wrong. 

Ini civaliim for innovation's sake is a false value. It crystallizes 
a practH prematurely and l)uilds up vested interests that discourage 
hardheadiMi inquir> and lend to prevent abandonment of the practice 
when ilst'.hlter \voars otf. 

NuA. what reruinmendaliun;^ can we make for the proper use of 
the university as a c(»nler for imiuiry into education? 

First, institutions outside the university should be developed to 
carry the main burden of demonstration, dissemination, and educa- 
lional devcl(»pmeni . The university should, insofar as possible, with- 
draw frv.m these activities, though u should make the knowledge of 
Its staff available to those who carrv them out. Just as aerospace 
firms and defense laboratories do the developmental work in those 
eimint*erinti fields and the pharmac eutical companies develop products 
derived Irom the fundamental studies of the medical school, so ed- 
urational products will be engineered in institutions resembling Ed- 
ucational Services, Inc., and' the KducahonaT Testinij Service. These 
agencies, and the school systems themselves, should do the bulk of 
m-service Iramiim v{ teachers, th^nigh the universities should con- 
tinue to transmit new ideas to the i»r(ifessi(;nal leaders and especially 
In th(»se who conduct the m-servire trainuH^, 

Second, research should be laru:ely centered m universities, 
since only the university has the long-range View that permits de- 
tached and penetratmu inquirv. U is tempting to think j)f establishing 
resf.inh \\nigs withm the development\uid dissemimltion institutions, 
but the h.ird fact is thai mjhis generation we need to engage every 
laliMited r('S(^archer as a trainer of researchers .uH therelore cannot 
.•^pare him fr^^^n^ the university. 

Third, ttu highest priority sht^ dd be given to lecruitment and 
ir.i.mng ol researr hers. Tins calls lor breakiai' down the barriers 
u.a\ iv^\K' exist belvveen scluH>hs ol education and other departments. 
Sulid irianniv; in (*ne ^r more ? t the b(*havioraL social, and humanistic 
disciplines i.-^ indisi)CMisable tor th(»Ui*!iltul educational research, 
SchuMls of educati»>!i alout^ iwu rarelv ^ive that trainiiitc, 

lV>artlu '.t si utdd ideuiitv Mie youri^\sters whv) have the greatest 
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prunusc as \ •uLiiionlal a'SUt»ulors and should establish the cuii- 
diiinas .iiid»a whiiii ihe> are most likely to become scientific revolution- 
ari( .s. This means, first of all, financial support for exploratory and 
uncohveiiiiciaal studies, as well as for the neatly canned studies of 
nornuil science. It means encouragement of the liigh-risk activities 
thai do noi aluays pay off, rather than a count -the -publications re- 
uard >vst(>ni that locks a man into pedestrian normal science. !t 
mtan.-v eii( imraumti; the man to work on a modest budt^et that leaves 
luin tree 'o Mnnk about his own data. 

r*je nnprtjvoment of education rests first of all on commitment 
lu ilif- l)(iiet that the life of every individual and every nation, and 
M)CifMv c»s a wliole. can be lifted to a higher plane of significance 
throiii;h cultivation of the intellect. But improvement will be slight if 
educational efforts are illuminated by goodlieartedness alone. It is a 
( riU 1 hoax to hail an unsubstantiated method as a cure for an educa- 
tional defuiency, to adopt ii is only 'to delay the search for underlying 
c aiise^s arKi for treatments matched to these causes. Intellect begins 
to play bomi, ri)le in our educational decisuais when we test the claims 
|»f rach new method' by assessing its effects in pilot schools. But the 
inu Ueci takes up its proper dutv when it tell5 us how education and 
l.ettiniau proceed, v«ihen it tells us whv one approach works and another 
ik*v^ at)t. when it identities the variables that we must adjust to achieve 
a prcsciibed cifcct. The proper mission of the university is to con- 
st r^un. bit by i)it, thus theory of instruction and of educational systems, 
A^iic others work (»n stopgap empirical solutions for educational pro- 
bh. m,^ of the moment, 

, Phe lace b^uvren education and catastrophe is not a 60-yard dash, 
not a maturk)r spurts of hoi-breathed energy. Our generation has a 
long lap i(» run. May our pace be strong and our direction sure. 

Foi the person concerned prolessiomClly with the improvement of 
edu<alii»n. fiiis is a time ol exhilaration and of despair --exhilaration. 
i>('(ause oui' opportunities luve expanded ta the point where we can 
<ihnost u{\ (hat progress is hmited only by our capabiiilies, despair 
brcausr our (MpabiliiieN aro hmiiino indt ed. Prodigious demands are 
pLiced the st hooTlnst because it is the one institution under public 
e«>iitror[hat can ri(!ibera*eh cultivate Client and emotional resources-- 
Uuii ot) the one hand give individuals tt ( freedoni and tools where - 

they rarve I u[ a i-.ood lite, and that caii on the other integrate 
so( MMy at*«>ui d principles ot oppoilunity and justice. The nation is 
read; U back a hi^roic eifori to aC(*omplish these ends, but we i)rofessK)n 
ab> d« hot Kr» w < a ugi al)out learning and mslruction to design the de- 
^ireil rt'lorm. 

(^Milinue on Next Paui 
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V ; Uc 1 t Jh j)iaL->r Mi Mk- Inuhest tt-rm.s the new conmHtmenI to 
rdut.rjoii a:Kl ti.i ( lUliusiain Ai!h whu h schi;uls are searchiiiix for new 
pra(tt<".s. I am r*MU ( un>d leb> the niovfMiiieni may cause the univer- ' 
Hitii's. an^l |);n hculai'lv^ii>e:Ji* schonls of education, to n(*iilect their 
true aiul •iMMjuf* Unni.ou. Jl iho.se wlui.se first calling ib the study of 
i-diuaht ti fjtiA \yO '-li (he- rube nl tlie scli«dar and don the armt)r of the 
crusadt i Ha v vvMl betrav tlie public by leaving the sclndar's badly 
lu vtU'i\ work luidi Le. 

1 liri' ivr educational desicns. worth careful di v^elopiiient and 
lield tnal. tan entente .)nly Ironi a deep uudersiandinq; of learnmi; and 
mutnatuMu 

In the prt^ces.s l)v.\\lv.i h educatinn is improved, we recognize a 
^i-quence i»f acMvitn^s ihal stai with nasic invei?liga! iai of the condi- 
ii«ins affeitm^; learnum. motivation, and instructional effectiveness: 
\'arn(*s ou ihrou^h an engineering phase m which practical procedures 
are desiitnetl. ie>ied. and redesigned unlil they are truly effective, and 
end> in 4 oiarkeium pliase \u which schools are persuaded to adopt 
the impioM'd methods and teachers are trained to use- them. Research, 
devebipmeivt. dissenunation--all three are necessary to keep the ed- 
ncati nal svsirm niovmi; b)rward. 

Of the three. K^search is the moSJ ditficuli to foste^^ Multiplying 
research »ip()i opi lat e ns ajII not do tlie job l)ecause insi^^btful research 
rcquirt's irannni; aiid aitiiud'^s thai are in very short supply. There 
.ire fev^ umUv excellent pprstjjis m (»ducatit)nal research careers today. 

No uui\(*rsiiv can or should fill its lacuUy entirely with research - 
er.s. any iacult\ mat iu)W contain.^ a modest number ot scljolars 
capal)l(» i»l tuudamintal Mr)Ughi about educatn»nal mslilulions should 
assii'n fu st pnonlv lo cultivaiitm of Ihaj^ .scholarly capability. With 
ihe most ireful (oi '-eni ration existum talent ajid development of 
poKMihal ^ileM. we nui;!it build up m ihis country bv 1970 a dozen in- 
.siituiions with W' 11 i.^-mded prngranis ol scholarship iii education. 
Tlu-^ will >^app«-f howfv^M . onlv il the bi tter uni\( rsities hold downi 
thi r I MninvU mciits :»» (h vel('|)men( and dissemination in order to give 
tirsi aM(.Jsti'»a ^^N^the rtsearch mission. 
\ 
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Appendix A-8 Posttest Used In All Groups 



The next few pages contain selections of poetry. You are to 
identify each selection by writing "yes" if you think the selection is 
and example of trochaic meter poetry, and "no" if you think the 
selection is not an example of trochaic meter. You may spend as 
much time per iter.i as is necessary to determine the classification. 



When you have finished reading the above, please continue to the next 
page. 
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1. prouched on the pavement, close by Belgrave Square, 
;a. tramp I saw, ill, moocly, and tongue-tied. 

. (Arnold) 

2. Up goes the lark, as if all were jolly 
cdver the duck -pond thq willow shakes. 

(Meredith) 

3. Break, break, break. 

At the foot of thy crags, O Seal 
And I would that my tongue could utter 
The thoughts that arise in nle* 
(Tennyson) 

4. Mine eyes have seen the glory of hard work at least. 
I have kept the bore unpitted and the action greased. 
Even when it ain- 1 a fit night out for man or beast. 

(Starbuck) 

5. Welling waters winsome wo3;*d 
Wind in warm wan weather . 

(Swinburne) 

6. Hgerl Tiger! Burning bright 
In the forests of the night. 
What immortal hand or eye 

Could frame thy fearful symmetry? 
(Blake)^ 

7. Yet, as if grieving to efface 
All vestig6 of the himian race. 

On that lone shore loud moans the sea, » 
But none, alasi shall mourn for me I 
(Wilde) 

8. When the brokers are roaring like beasts on the floor 

of the Bourse, 

And the poor have the sufferings to which they are 

fairly accustomed. 
And each in the cell of him^lf is almost .convinced 

of his freedom; 
, A few thousand will think of this day. 

(Auden) 

After you have answered all of the above questions, continue to 
the next page, * • ' V ^ ^ 
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^' Since I can never see your face, 
And never shake you by the hand, 
I send my soul thrcu gh times and space 
To greet you. You will understand. 
(Flecker) ■ 

10. Oh,- to be in England 
Now that April's there. 

(R. Browning) 

11. Fleas 
Adam 
Had* em 

(uiiknown) 

12. Peace is come and wars are over. 
Welcome you and welcome all. 
While the charger crops the clover 
And his bridle hangs in stall. 

(Housman)_ 

13. But a young soldier came to our town. 
He spoke his mind most candidly. 

He asked me quickly to lie down, . 
And that was very good for me. 
(Wickham) 

14. Men of England, wherefore plow 
For the lords who lay ye low? 
Wherefore weave with toil and care 
The rich robes your tyrants wear? 

(Shelley) 



15. 



16. 



Beautiful must be the mountain when ye come. 
And bright in the fruitful valleys the streams wherefrom 
Ye learn your song: 
(Bridges) 

Somehow--! know not how— as if she ranked 
My gift of nine -hundred -years old name 
With anybody's gift. 

(R. Browning) 

After you have finished answering the above questions, continue 
to the next page. 
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17. The sun that brief December day 
Rose cheerless over hills of gray. 

(Whittier) 

18. There's a barrel organ caroling across a golden 
Street in the city as the sun sinks low; 

(Noyes) 

19. Therefore he rode and hunted as he might, 
Greyhounds he had, swift as a finch in flight; 

(Chaucer) 

20. Come down, 0 maid, from yonder mountain height. 
What pleasure lives in height (the shepherd sang) 
In height and cold, the splendor of the hills? 

(Tennyson) 

21. He says we are beggars 

(Randall) 

22. Wild Spirit, which art moving everywhere; 
Destroyer and preserver; hear, 0, hearl 

(Shelley) 

23. The God of love my Shepherd is, 
And He that doth me feed 
While He is mine, and I am His, 
What can I want or need? 

(Herbert) 

24. Spanish waters, Spanish waters, yci are ringing in my ears 
Like a slow sweet piece of music from the gray forgotten yeai's; 
Telling tales and beating tunes, -and bringing merry thoughts to me 
Of the sandy beach at Muertos, where I would that I could be, 

(Masefield) 

25. From the ghoulies and the ghosties 
I Go out ghastly grumblings, , 

(anonymous) 

26. Wee, sleekit, cowin, tim'rous beastie, 
Oh, what a panic's in thy breastie! 

(Burns) 

After you have answered all of the above questions, continue to the 
next page. 
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27. Pile the bodies high at Austerlitz and Waterloo. 
Shovel them under and let me work-- 

I am the grass; I cover all. 
(Sandburg) 

28. Along, alone, alas, he sot. 

(unknown) 

29. Glory be to God for dappled thin^s-- 

(Hopkins) 

30. My mind to me a kingdom is, 
Such present joys therein I find. 

(Dyer) 



Af^er you have answered all of the above questions, coirfinue to 
*^he nex^ page ^ 
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Appendix A -9 Introduction to Groups 9, 10, 11, 12 



The following pages will present to you a program to teach 
the concept of trochaic meter. Your program will present examples 
and nonexamples of trochaic meter. Study each program carefully. 




When you have finished reading the above, please continue to the 
next page. 



Appendix B Tests 

B-I Answers to Pretest 



1. Yes 

2. Yes 

3. No 

4. No 

5. Yes 

6. No 

7. Yes 

* 

8. Yes 

9. No 

10. Yes 

11. No 

12. No 

13. No 

14. No 

15. Ye4 



PRETEST" 

16. Yes 

17. No. 

18. No 

19. No 

20. ^No 

21. No 

22. Yes 

23. Yes 

24. No 

25. Yes 

« 

26. Yes 

27. Yes 

28. No 

29. No 

30. No 



B-2 Answers 

1. No • 

2. Yes 

3. No 

4. No 

5. Yes 

6. Yes 

7. No 

8. No 
9. . No 

10. Yes 

11. No 

12. Yes 

13. No 

14. Yes 

15. No 



POSTTEST 

16. No 

17. No 

18. Yes 

19. No 

20. No 

21. Yes , 

22. No 

23. No . 

24. Yes 

25. Yes 

26. No 

27. Yes 

28. No 

■J 

29. Yes 

30. No 
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Appendix C-List of Poetry Selections Used In Instance Probability 
Analysis 

Never ask of Autumn's falling colors 
Where they go; the future days grow duller. 

(unknown) 

• 

Tasks in hours of insight willed 

Can be through hours of gloom fulfilled. 

(Arnold) 

Nor marble, nor the gilded monuments. 
Of princes, shall outlive this powerful rime; 
But you shall more bright in these contents 
Than uns wept stone, besmeared with sluttish time. 

(Shakespeare) 

White were the moorlands and frozen before her. 
Green were the moorlands and blooming behind her. 

(Kingsley) 

• * 

Pushing through the clouds 
Chasing ghosts and shrouds. 
^ . (unknown) ^ 

Let the day perish wherein I was born, / . 
And the night in which it was said.^ * ^ 

There is a rnan child conceived, ' '^-\ 
Let that day be darkness 

(Job: Bible) . " • 

Says he, ''Dear James, to murder me 

Were a foolish thing to do. 
For don't Vou see that you can't cook me. 

While I can--and will--cook youT' 
. (Gilbert! 

My^ind to me a kingdom is 
Such pxesent joys therein I find. 

(Dyer) 



And we just made it out of the Big' Muddy 
With the captamxdead and gone. 

\^ (Seeger) ' 

\ 

\ 

\ 
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10. Soft and easy is thy cradle 
Course and hard thy Savior lay. 

(unknown) 

11. I will go up to the mountain 
And there I will light a fire. 

(Austin) 



Through the noises of the night 
She floated down to Canielot: 

/ (Tennyson) 



13. The smiles thatSvin, the tints that glow, ^ 
But tell of day^ in goodness spent, ^ 

(Byron) 

14. Maid of Athens, we^^e we part, 

■ Give, oh give me back my heartl 

(Byron) 

15. ^ Out of fiendship*^came the Redman r 

Teaching settlers where the deer ran. 

(Imitation, Hiawatha) 



16. He says we are beggars. 

(Randall) 

17. Glory be to God for dappled things- 

(Hopkins) 

* 

/ 18. Have I not passed thee oh the wooden bridge. 

Wrapt in thy cloak and battling with the snow. 
They fact toward Hinksey and its wintery ridge? 

(unknown) 

19. AH the hapless silent lovers. 

All the prisoners in the prisons. 
All the righteous and the wicked. 
All the joyous, all the sorrowing. 
All the living, All the dying-, 
PioneersI 0 pioneers! . . ^ 

(Whitman) 



Ruth and Naomi gathered corn and wheat stalks. 
They are not afraid but feel secure. 
God and Boaz watch their ,walks, * 
Taking care that they find plenty near, 
(unknown) 

Motherly, Fatherly, Sisterly, Brotherlyl 
(unknown) 

But the wind can so easily wjiip 

The still water to foain. 
And the harmless bay. waves turn 

To storming gray boulders that pound, 
(unknown) 

Ta^fe her up tenderly, . 
Lift her with care; 

(Hood) 

/ 

Ho.w hast thou merited 
Of all man's clotted clay the dingiest clot? 
Alack, thou knowe^t not 
How little worthy of any loVe thou artl 
(Thompson) 
♦ * ,* 

If the heart of man is depressed with cares, ^ 
. The-mist is dispelled when a woman appears. 
(Gay) 

Out of childhood ipto manhood 
Now had grown my Hiawatha. 

' (Longfellow) 

^ The God of love my Shepherd is, 
*And He that doth me feed, , 

While He is mine, and I am His, 

What can I want or need? 

(Herbert) 

When I was one -and -twenty 

I heard a wise man say, 

"Give crowns and pounds and guineas, 

But not your heart away. 

(Housman) 
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' 29, .Give every man thy ear, but few thy voice, - • . 

This above all: To thine own self be" true. 

(Shakespeare) 

30* ''Spanish ships of war at seal We have, 

sighted fifty -three 1 " ^ 

- (Tennyson) ^ 

31i Heartless, Hopeless, v!/ithout feeling, 

(unknown) » 

32. Pansies, lilies, kingcups, daisiep." 

(Wdrdsworthj 

33. He says we are beggars and I say 

When it comes to love we are orphans ^ " , ^ 

We are all misplaced or displaced 
Persons from .another war. 

(Randall) ' ^ 

34. Come to the crag where the beacon is blazing,' ' h 
Come with the buckler, the lance^ and the bow. 

(Scott) 

35. Where are tjiesongsof Spring? Ay, where are they? 
Think not of them, thou hast thy music, too, 

(unknown) . ' \; • . ^ 

36. Now the day is over. 

Night is drawi ng nigh . • ' ' 

Shadows of the evening ' . 

Steel across the sky. 
^ (Sabine Bariag -Gould) 

37. We stripped and dived and found his body 
Stuck in the old quicksend. 

(Seeger) 

# 

38. Since I can never. see your face. 
And never shake you by the hand, 

I send my, soul through times and space 
To greVtVou. You will understand. 

^Flecker) 

V 



Oh, to be in England 
Now that April's there. 

(R. Browning) 

My father, he was a mountaineer. 
His fist was a knotty hammer'; 
He was quick on his feet as a running deer, 
And he spoke with a Yankee stammer. 
(Benet) 

Peace is come and wars are over,. 
Welcome' you and welcome all. 
While ,the charger crops the clover 
And his bridle hangs in stall. 

(Housman) 

But a young soldier came to our town, 
He spQke his mind most candidly. 
He asked me quickly to Me down, ' ' 

And that was very good for me. 
(Wickham) 

Men of England, wherefore plow 
For the lords who lay ye low? 
Wherefore weave with toil and- care 
The rich robes your tyrants wear? 
(Shelley) • 

Beautiful must be the mountain whence ye come. 
And bright in the fruitful valleys the streams where fro 
Ye learn your song; 

(Bridges) 

Somehow--! know not how --as if she ranked 
My gift of nine -hundred -years -old name 
With anybody's gift. 

(R. Browning) « . 

The sun that brief December day 
llose. cheerless over hills of gray. 
(Whittier) 

X 

There's a barrel oi^gan caroling across a golden 
Street in the city as the sun sinks low; 
(Noyes) 
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48. Crouched on the pavement, close by Belgrave Square 
A tramp I saw, ill, moody, and tongue -tied. 

(Arnold) 

49. Up goes the lark, as if all were folly 
Over the duck -pond the willow shakes. 

(Meredith) 

50. Break, break, break 

At the foot of thy crags, O Seal 

And I would that my tongUe could utter 

The thoughts that arise in me. 

(Tennyson) 

51. Mine eyes have seen the glory of hard work at l^ast. 
I have kept the bore unpitted and the action greased. 
Even when it ain^t a fit night out for man or beast, 

(Starbuck) 

52. Welling waters winsome word . ' 
Wind in warm, wan weather. 

(Swinburney 

«• > • 

53. Tiger: Tiger! Burning bright 
In the forests of the night. 

What imniortal hand or eye ' , 

Could frame thy fearful symmetry? 

(Blake) 

54. Yet, as if grieving to efface 
All vestige of the human race. 

On that lens where loud means the sea, 
But none^ alas I shall mourn for mel 

(Wilde) 

55. When the breakers aie roaring like beasts on the floor 

of the Bourse-, 
And the poor haVe the sufferings to which they are 

^ / fairly accustomed. 
And each in the oglj^f himself is almost convinced 

of his freedom; 
A few thousand will think of this day* 

(Auden) 
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56. Therefore he rode and hunted as he might, 
Greyhounds he had, swiffas a finch in flight; 

(Chaucer) 

57. Come down, O maid, from yonder mountain height. 
Wliat pleasure lives in height (the shepherd sang) 
In height and cold; the splendor of the hills? 

(Tennyson) 

58. Spanish waters, Spanish waters, you are ringing in my ears 
^ Like a slow sweet piece of musip from the gray forgotten 

years; 

Telling tales, and beating tunes,' and bringing weary 

thoughts to me \ 
Of the sandy beach at Mtiertee, where I would that I could 

be. 

(Masefield) 

59. Wild Spirit, which art moving everywhere; 
.Destroyer and preserve^ hear, 0, liearl 

(Shelley) ^ . 

60. Maybe I shall find, them among the dead. 
Hear me, my chiefs, r^' 

I am tired.. My heart is sad ^d sick. 

(Joseph) 

61. Soldier from the wars returning. 
Spoiler of the taken town. 

Here is case that aSks not earning; 
Turn' you in and sit you down. 

(Housman) 

62. From ghoulies and ghosties 
Go out g^^astly grumblings. 

' ' (anonymous) - * , 

63. Wee, sleekit,. cowin, tim'rous beastie, 

Oh, what a panic's in thy-breastie! . i 
I (Burns) 

'64. . Pile the bodies high at Austerlitz and Waterloo. 
Shovel them under and let me work-- 
I am the grass; I cover 'all. 

(Sandburg) ^ 
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65. Along, Alone, alas; he sat. 

(ujiknown). 



66. ' Lay a garland on my hearse of the dismal dew, 

Mai(^ens willow branches bear, say I died true. 
My love was false, but I was firm from my hour of birth; 
. Upon my buried body lay lightly, gently, earth: 
(Fletcher) 

67. ^ When they shot Malcolm Little down 



On the stage of the Audubon Ballroom, 
When his life ran out through bullet holes 
(Like people running out when the murder began) 
His blood soaked the floor, 
(Patterson) 

68. I am monarch of all I survey. 

(Cowper) 

69. Tho^ whd wilt not love do this; 
Learn of me what Woman is, 

(Herrick) 

70. Tis hard to say if greater want of skill 
Appear in writing or in judging ill. 

(Pope) 



71. Could I but live again 

Twice my^lif6 over, * 
Would I meet strive again? 

(R. 'Browning) 

72. Wailing, Wailing, .Wailing, the wind over 
land and sea-- 

• (Tennyson) 

73. Fleas, 
Adam 
Had' em 

(anonymous) ^ 

74. Sure solacer of human cares, 

f And sw,eeter hope, when hope despairs! 
(Bronte) 



I want to know 
What is really 
Going on. . 
(Resendez') 

A crack was in the glass 
(unknown) 

The God of love my Shephercf is, 
And He that doth me feed, 
While He is mine, and I am His, 
What can I want or need? * 
(Herbert) 

78. There they are, my fifty men and women. 
Naming me the fifty poems unfinished! 

(R. Browning) 

79. Memory tells meWiJie many timvis 
We were three in a room, trapped 
By the all -constricting walls of a 

summer shower. 
• ^ (Lee) 



75. 

76. 
77. 



80. Darkness calling; calling. 
'I fear: You do not. 
Pass by, darkness. 
Leave me, angels -- 
*^ Let the daylight return, 
(unknown) 

Boys in sporadic, tenacious droves 
Come with sticks, as certainly as Autumn 
(Eberhart) 

T'ae win^ of life keeps oozing drop by drop. 
(Fitzgerald) 

83. The readers of the Boston Evening Transcript 
Sway in the wind like a field of ripe corn. 
(Eliot) 



81. 



82. 



\ 

\ 



84, \ I don't know why she didn't like my saying 

\that. She gave jjie her plaintive smile and her 
beautiful eyes filled with tears. 

(Maugham) ^ 

85. TakeXthought: " ' 
I have' weathered the storm, 

■ I have bieaten.out my exile. 

(Pound) ' • . 

% 

X 86, Once more within the Potter^s house alone 
I stood, surrounded by the Shapes of Clay. 
(Fitzgerald) 

^ 87, Come, my Celia, let us prove 

While we can, the sports of love; ♦ I 
Time will not be ours forever. 
He, at length, our goods will sever. • , 
(Johnson) 

88. Never ask of Autumn's falling colors - ' 
Where they go; the future day^ grow duller, 
(unknown) 

'89. Tasks in hours of insight willed 

Can be* through hours of gloom fulfilled. 
(Arnold) 

90, Nor marble, nor .the gilded monuments 

Of princes, shall outlive this powerful rime; 
But you shall shine more bright in these contents 
Than unswept stone, besmeared with sluttish time. 
(Shakespeare) 

'\ • 

91, White were the moorlands and frozen before her. 
Green were the moorlands and blooming behind her. 

(Kingsley) 

■ 

92, Pushing through the clouds " 
\ Chasing ghosts and shrouds. 

(unknown) 
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C-1 Instance Probability Analysis for Exemplars 



Selection # Percentage ' 



Eg 



14 
30 
36 
41 

5.3 



81% 
82% 



8'2% 



Selection # Percentage 



85 
81 
78 
64 
49 
17 
•7 



49% 
47% 
,47%'^ 
42% 
44% 
46% , 
46% 



.69 
58 
52 
43 
32 
26 
19 
10 



•70%' 

73% 

72% 

75% 

74% 

75% 

76% 

77% 



68" 

62 

60 

37 

23 

20. 

16 



3^0 
35% 
37% 
3f4% 
36% 



92 
87 
80 
72 
61 
39 
31 
15 

5 

1 



68% 
68% 
62% 

% 
% 
% 

00 



JO 

64% 



75 
47 
35 
33 
11 



25% 
24% 
20% 
22% { 



89 50% 
88 58% 
2 59% 



r 
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C-2 Instance Probability Analysis Nonexemplars " 

Selection r Percentage ^' Selection* Percentage 

^) • 82% ■ 90 50% • 

. 22 • • 85% 91 * 56% 

83 82% 76 69% 

74 52% 
73 ' ' 52% 

70 56% 



18 
3 



1'! 



66 

84 75% , 63 • 52% 

79 ^ 74% • - 57 

7J 74% 56-1 

67 ■ 76% . ■ 38 

55 . . 72% \ '4 

50 70%. . . 

44 V 76% 

42 - 73% ' . 

24 70% 

6 76% . 86 46% 

b5 43% 
46 42% 
28 45% 
27 41% 

82 • 69% ' 12 . 47% 

59- • • 64% 8 40% 



54 
51 

40 64% 

34 62% 

29 69% 77 

25 ■ '63% 45 

21 64% 13 34% 



'0 
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Analysis of Variance Table 
For Correct Classification ^ 



Source 


• 

df 


\ 

MSE ' 

' — ' 


F 


Tr6atnients (A) 




331.38 ^ 


23.67* 


Pretest vs. No Pretest (B) 


\ 


1.09 ' ■ 


0.07 


AXB 


8 


12.86 


0.92 


Error 


162 


14.00 





*p<.01 



4 



i 



♦ • * 



• /■ 



f 
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Analysis of Varianee Table 
For Overgeheralization 



Source 


. df 


1 

■MSE 


F 


» 

Treatments (A) ' 
Pretest vs. No Pretest (B) 
A'XB 
Error 


8 
1 
8 
162 


'248.81 
23. 92 
17.63 

15.93 ' . 


15.57* 
1.49 
1. 13 



*p<.or 
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Appendix D-3 

1 



AnalywSis of Variance Table 
For Undergeneralization 



' Source 



Treatments (A) 

Pretest vs. No Pretest (B) 

A X B ' . 

Error ' . ^ ' 

1 

*p<.01 



df 



8 
1 
8 

162 



MSE 



429.57 
35.82 
28.13 
14. 42 



1 lu 
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Analysis of Variance Table, 
For Misconception 









'■ Source 


di 


MSE 


Treatments (A) - 


8 


64.00 


Pretestvs. No Pretest (B'^ 


■ A 


13.47 


AXB " 


8 


vl9.33 


Error 


162 


- 13.25 



'p<:.oi 



Appendix Study Two / 

/ / 

/ ) 

/ 

/ 

A TnfroHnpfinr< fn oil r)r.^rv««^« 



A 


lutrnuuctipn to ail ir rograms 


B 


IntrndiK^tinn fn Prnfncf 


c 


XTX C Leo t * 


D 




E 


TntroHnpfinn fn TVaclr 

If . ' 


F . 


r)pfinif*inn nf T?Yrk O-nxrofnlo 
i 


G 


v^orre.ct v^iassiiication lask 


H. 


v>^vergen6raiizaiion lasK 


I 


unaergeneraiizaiion i ask 


J 


ivnsconcepiion lask 


K 


introuuction to JNonreievant lask 


L 


iNuurtJievant lasK 




introQuction to irosttest 


N 


JrOStteSt > 


0 


riUcrVttJrb tO XrOStt6St 


p 


Posttest Probabilities 




Construction of Posttest 


R 


Construction of Tasks 


S 


Conclusion to Program 


T 

i 


Analysis of Variance Tables 
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Appendix A Introduction To All Programs 



Dear Student: 

. You hatve been selected to participate in a research grant funded 
by the United States Office of Education. The instructions you p^e to 
receive have been developed to attain specific informatioji. PI 
follow all directions carefully, y 

• This program is designed to be self -instructional. The experiment- 
er cannot answer any CLuestions. If for some reason you cannot con- • 
tinue with the program, please take the program to the experimenter 
and leave quietly. There are not timed breal^s so once you begin, 
continue until finished. 



When you have finished reading the above, please continue to the next 
page. 
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Appendix B Introduction to Pretest 



The next few pages . will contain pictures of crystals which you 
are to identify either as being examples of RX2 crystals or not ex- 
amples of RX2 crystals. This is a pretest and it is used to determine 
your knowledge of RX2 crystals before you are given instructions. We 
assume that most, students are not familiar with RXo crystals. 

After viewing each crystal, if you think the item is true (an ex- " 
ample of a R^g crystal), mark "T" on the IBM answer sheet, if 

nnfhi ^" '^^"^P^^ °f ^ ^2 crystal), mark 

r on the IBM answer sheet. 



When.xou have finished reading the above, please continue to the next 
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Appendix D Answers to Pretest 

1. T ' . 

■3. T 

4. F ■ , ' 

5. T 

6. T ' ' • 
.7. T 

8. F ^ • 

9. F. - ' 

10. T 

11. T 

12. F 

13. T 

14. T 

15. T 
4 



\ 

\ 
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Appendix E Introduction to Task 



The following pages will present to you a program to teach the 
concept of RX2 crystals. The programs vary in length according to 
a random selection. Study each program carefully. 



f 



When you have finished reiading the above, please continue to the next 
page. 
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.Appendix F Definiti^ of RX2 Crystals 

Read the following definition of crystals carefully. You can return 
'to this page during the program. After studying- the definition, you will 
be tested on how well you can identify jexampl^s from nonexamples. 

Definition: / 

Crystals are made up of groups of identical molecules which are 
comprised of spheres called atoms. The single crystals you are to*be , 
tested on inay not be complete in and of themselves, but remember 
that crystals are always symmetrical, so what you don't see Aiay still 
be present. You must attune yourself to the basic atomic structure or 
the repeating clusters of atoms. There is a type of crystal called 
RX2 which has a two to one ratio in its atomic structure, i. e. , for a 
given atom there will be another two atoms (or clusters of atoms) 
attached to it in repeating fashion. 

The test item pictures have been shaded to show dimension and 
depth. You will be shown 8 examples and 8 nonexamples, then you will 
be tested. 



TURN THE PAGE AND CONTINUE WITH THE PROGRAM * 
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Appendix G 
^ Correct 
. Classification Tas 




EXAMPLE 




NOT AN EXAMPLE 

ERIC . , 
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EXAMPLE 



V 




NOT AN EXAMPLE 




EXAMPLE . 



NOT AN EXAMPLE 
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^1 



B 



EXAMPLE 




NOT AN EXAMPLE 



EXAMPLE 




EXAMPLE 



3 



I. 

NOT AN EXAMPLE 
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EXAMPLE 
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\ 



EXAMPLE 



/ 




OT AN EXAMPLE 
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Appendix H 

Overgeneralization 

Task 




EXAMPLE 




NOT AN EXAMPLE 
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EXAMPLE 




NOT AN EXAMPLE 
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I 

V 




I 

EXAMPLE • 




/. 

NOTANEXAMPIE 
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Appendix I | 
Undergeneralization' 
Task 




EXAMPLE 




EXAMPLE 




NOT AN EXAMPLE 
Mi 



EXAMPLE 

r 



NQTAN EXAMPLE, 

. Mo 



4 
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EXAMPLE 




r 



NOT AN EXAMPLE 
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B 

0 

EXAMPLE 




} 



NOT ^ EXAMPLE 
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V 

EXAMPLE 




NOT AN EXAMPLE 
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Appendix K Introduction to Nonrelevant Task 



Your program will consist of reading selections from an article 
by Lee J. Cronbach. The article "The Role of the University in Im- 
proving Education," presents some very sound information which all 
students in educational psychology should be aware of. 



When you have finished reading the above, please continue to the r.«xt 
page. 
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Appendix L Nonrelevant Task 

/ 

The cry today/is for instant improvement of the schools, and 
there is pressure for wholesale dissemination and development activities 
without the necessary prior research. The educator from the field in- 
variably asks the university to help him with today's problems, and 
that is understandable. It is understandable, but more, deplorable, 
that Congress spasmodically lashes out with crisis -oriented legislation 
but is unsympathetic to balanced, across-the-board, long-range plans. 
It is tragic that in the U.S. Office of Education the Bureau of Research 
has thrown its forces heavily on the side of "practical products" and 
dissemination.' While the USOE is a passive patron of basic research, 
it has done nothing to formulate and sell to Congress a policy that will' 
promote the healthy development of basic investigation. 

What the USOE views as research is well illustrated by an early 
1966 press release in which it reports enthusiastically on the use of 
electronically compressed speech to teach the blind, the teaching of 
first-graders by tape recorders, and teaching third -graders to sing 
medieval plainsong. Some ad hoc novelties such as these have practical 
value, and they deserve a. trial. But the research program ought to 
have the higher objective of reexamining educational ideas and the 
underlying of mental development is true, and what does it imply for 
educators? How can we account for growth in ability to form elaborate 
sentence structures? How does motivation for achievement develop? 
What part does personal identification with the teacher play in forming 
character and interest? And so on. 

Massive dissemination encourages faddism in education. What 
sounds like a good idea is launched nationwide long before it has been 
determined that the methods used are really suitable. There is no 
evidence to justify, for example, the California legislation that re- 
quires instruction in foreign language in grades six to eight; the assump- 
tions used to justify the requirements are untested and with the law now 
a fait accompli , no one is about to test them. The energies of the 
people who might be giving thoughtful attention to language instruction 
are diverted into a crash program to write curriculum materials and 
train teachers. The Head Start program is easier to justify, since it 
reflects a national acceptance of responsibility for the disadvantaged 
child, and one cannot waste a generation of children while waiting for 
research. But psychologists do not know whether any of the intervention 
programs now being installed can produce lasting benefit to intellectual 

Continue on Next Page 
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development ; the progrms differ so radically in their assumptions 
that we can almost be certain that some of them are wrong. 

Innovation for innovation's sake is a false value. It crystallizes 
a practice prematurely and builds up vested interests that discourage 
hardheaded inquiry and tend to prevent abandonment of the practice 
when itsglitter wears off. 

Now, what recommendations ckn we make for the proper use of 
the university as a center for inquiry into education? 

First, institutions outside the university should be 'developed to 
carry the main burden of demonstration, dissemination, and educa- 
• tional development, The university should, insofar as possible, with- 
draw from these activities, though it should make the knowledge of 
its staff available to those who carry them out. Just as aerospace 
firms and defense laboratories do the developmental work in those 
engineering fields and the pharmaceutical companies develop products 
derived from the fundamental studies of the medical school, so ed- 
ucational products will be engineered in institutions resembling Ed- 
ucational Services, Inc. , and the Educational Testing Service. These 
agencies, and the school systems themselves, should do the bulk of 
in-service training of teachers, though the universities should con- 
tinue to transmit new ideas to the professional leaders and especially 
to those who conduct the in-service training. 

Second, research should be largely centered in universities, 
since only the university has the long-range view that permits de- 
tached and penetrating inquiry. It is tempting to think of establishing 
research wings within the development and dissemination institutions, 
but the hard fact is that in this generation we need to engage every 
talented researcher as a trainer of researchers and therefore cannot 
spare him from the university. 

Third, the highest priority should be given to recruitment and 
training of researchers. This calls for breaking down the barriers 
that now exist between schools of education and other departments. 
Solid training in one or more of the behavioral, social, and humanistic 
disciplines is indispensable for thoughtful educational research. 
Schools of education alone can rarely give that training. 

Fourth, we should identify the youngsters who have the greatest 

Continue on Next Page 
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promise as fundamental investigators and should establish the con- 
ditions under which they are most likely to become scientific revolution- 
aries. This means, first of all, financial support for exploratory and 
unconventional studies, as well as for the neatly canned studies of 
normal science. It means encouragement of the high-risk activities 
that do not always pay off, rather than a count -the -publications re- 
ward system that locks a man into pedestj:;^ian normal science. It 
means encouraging the man to work on ^modest budget that leaves 
him free to think about his own data. 

The improvement of education rests first of all on commitment 
to the belief that the life of every individual and every nation, and 
society as a whole, can be lifted to a higher plane of significance 
through cultivation of the intellect. But improvement will be slight if ^ 
educational efforts are illuminated by goodheartedness alone. It is a 
cruel hoax to hail an unsubstantiated method as a cure for an educa- 
tional deficiency; to adopt it is only to delay the search for underlying 
causes and for treatments matched to these causes. Intellect begins 
to play some role in our educational decisions when we test the claims 
of each new method by assessing its effects in pilot schools. But the 
intellect takes up its proper duty when it'tells us how education and 
learning proceed, when it tells us why one approach works and another 
does not, when it identifies the variables that we must adjust to achieve 
a prescribed effect. The proper mission ^of the university is to con- 
struct, bit by bit, this theory of instruction and of educational systems, 
while others work on stopgap empirical solutions for educational pro- 
blems of the moment. 

The race between education and catastrophe is not a 60 -yard dash, 
not a matter for spurts'^ hot-breathed energy. Our generation has a ' 
long lap to run. May. our pace be strong and our direction sure. 

For the person concerned professionally with the improvement of 
education, this is a time of exhilaration and of despair --exhilaration 
because our opp'prtunities have expanded to the point where we can 
almost say that progress is limited only by our capabilities, despair 
^ecause our capabilities are limiting indeed. Prodigious demands are 
placed on the school just because it is the one institution under public 
control that can deliberately cultivate talent and emotional resources — 
that/-aaon the one hand give individuals the freedom and tools where- 
with they carve out a good life, and that can on the other integrate 
society around principles of opportunity and justice.. The nation is 
ready to back a heroic effort to accomplish these ends, but we profession- 
als do not know enough about learning and instruction to design the de- 
sired reform. ^ 

Continue on Next Page 
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while I can only praise in the highest terms the new commitment to 
education and the enthusiam with which schools are searching for new 
practices, I am concerned lest the movement may cause the univer- 
sities, and particularly their schools of education, to neglect their 
true and unique function. If those whose first calling is the study of 
education now put off the robe of the scholar and don the armor of the 
crusader, they will betray the public by leaving the scholar's badly 
needed work undone. 

Effective educational designs, worth careful development and 
field trial, can emerge only from a deep understanding of learning and 
motivation. 

In the process by which education is improved, we i*ecognize a 
sequence of activities that starts with basic investigation of the condi- 
tions affecting learning, motivation, and instructional effectiveness; 
carries on through an engineering phase in which practical procedures 
are designed, tested, and redesigned until they are truly effective, and 
ends in a marketing phase in which schools are persuaded to adopt* 
the improved methods and teachers are trained to use them. Research 
development, dissemination --all three are necessary to keep the ed- 
ucational system moving forward. 

Of the three, research is the most difficult to foster. Multiplying 
research appropriations will not do the job because insightful research 
requires training and attitudes that are in very short supply. The\e 
are few really excellent persons in educational research careers twiay. 

No univ^ersity can or should fill its faculty entirely with research- 
ers. But any faculty that now contains a modest number of scholars 
capable of fundamental thought about educational institutions should 
assign first priority to cultivation of that scholarly capability. With 
the most careful concentration of existing talent and development of 
potential talent, we might build up in this country by 1970 a dozen in- 
stitutions with well-rounded programs of scholarship in education. 
This will happen, however, only if the better universities hold down 
their commitments to development and dissemination in order to give 
first attention to the research mission. 



Continue on Next Page 
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Appendix M Introduction to Posttest 



The next few pages contain pictures of crystals. You are to 
identify each crystal by marking "T" if you think the crystal is 
an example of RX2 crystals, or "F" if you think the crystal is not 
an example of RX2 crystals. You may spend as much time per 
item as is necessary to determine the classification. If you did 
not receive the pretest, mark your answers starting with number 
16 on the IBM answer sheet. If' you did take the pretest continue 
marking on the IBM answer sheet with number 16. 



When you have finished reading the above, please continue to the next 
page. 
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Appendix O 
* Answers to Posttest 





Overg. 


Underg. 


Misc. 


CC. 


16 


rrx 

♦ T 


T 


T 


T 


17 


rrx TTi 

T-F 
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lo 
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T-F 
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T-F 
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F 
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F 
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F 


T 


T 




rn 
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T 


F 


T 
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T-F 
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rp 
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F 


T 
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rp T-i 

T-F 


F 


F 
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OT 
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rp T-1 




T-F 


F 


90 
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rp TTi 
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F 


T 


35 


T 


F 


T 


F 


36 


T 


F 


F 


T 


37 


T 


F 


T 


F 


38 


T-F 


F 


T-F 


F 


39 


T 


F 


F 


F 


40 


T-F 


F 


T-JF 


F 


41 


T-F 


F 


F 


F 


42 
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T 


T 


43 
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F 


F 
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T 


F 
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T 
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Appendix P Posttest Probabilities 



Posttest 
Number 

-• ~ 


Main book 
no. 


* example 


10 20 


30 


Probability 
40 50 60 70 


80 


90 


100 


16 


13 


* 














81 






17 


3 






33 
















18 


39 
















80 






19 


20 








42 














20 


4. 










58 













.—21. ^ 


14 










54 












22 


81 


* 




38 
















23 


28 


* 












73 








24 


83 














74 








25 


53 


* 








5g 












26 


49 














76 








27 


36 


* 










61 










28 


54 






34 


43 














29 


21 


* 






43 














30 


35 


* 




39 
















31 


12 












60 










32 


28 


* 












73 









33 


83 














75 








34 


17 


* 




35 
















35 


43 








49 














36 


40 


* 




39 
















37 


59 












60 










76 










56 












39 
40 


26 






34 










84 






77 










54 












41 


34 








42 


54 












42 


80 


* 






42 












lUO 


43 
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TOO 


44 


18 
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19 
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Appendix Q Posttest Construction 



Convergent 

eg. 13 eg. 64 eg. 80 

eg. 81 '\ eg. 35 eg. 53 

eg. 12 ^ eg. 76 eg. 54 

ig. 3 eg. 43 ig. 59 

eg. 20 eg. 77 ig. 83 

eg. 28 eg. 21 eg. 36 

eg. 17 eg. 18 eg. 40 

eg. 34 ei_J9 eg. 8 

eg. 4 eg. 14 eg. 26 

eg. 39 ig. 49 ig. 11 
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Appendix R Construction of Tasks 







Correct Classification 






Easy 


M-Easy 


M-Hard 


Hard 


eg 




33 


38 


70 


eg 


10 


29 


46 


20 


eg 


58 


44 


41 


69 


eg 


56 


3 


18 


52 



eg 
eg / 
eg^ 
eg 



Overgeneralization 



Hard 


Hard 


Hard 


Hard 


50 


22 


41 


33 


72 


20 


46 


3 


38 


58 


70 


35 


10 


42 


•» 


52 



Undergeneralization 







Easy 


Easy 


Easy 


eg 


25 


45 


60 


58 


eg 


20 


78 


29 


52 


eg 


63 


58 


13 


60 


eg 


10 


57 


61 


42 



Misconception 

eg 1 70 22 32 

eg 10 24 49 42 

£g 44 16 19 33 

eg 15 27 26 2 



*Note— This number is the same as in the main book from the 
Instance Probability Analysis 
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Appendix S Conclusion to Program 



You are now finished. Thank you very much for your participation 
in this study. The results should be available sometime this semester. 
If you are interested, please feel free to contact Dr. David Merrill 
(ext. 2635), and the information will be given to you. 



Please return this booklet to the experimenter and leave quietly. 
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Appendix T 

Analysis of Variance Tables 

Correct Classification 
Analysis of Variance 





Sum of Squares 


Df 


Me^n Square 


F Ratio 


Between Groups 


- 263.5600 


4 


65. 8900 


4.6867^ 


Within Groups 


1335. 6000 


95 


14.0589 




Total 


1599.1600 


99 


« 





*u.<.oi. ■ 
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Misconception 
Analysis of Variance 



Sum of Squares Df Mean Square F Ratio 

Between Groups 553.2600 " 4 138.3^0 7.1791* 

Within Groups 1830.3000 95 

Total 2383.5600 99 



19.266^</ 



*p<.01. 
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Undergeneralization 
Analysis of Variance 



• 


Sum of Squares 


Df 


f 

Mean Square F Ratio 


Between Groups 


290.0400 


4 


72.5100 3.2991* 


Within Groups 


2088. 0000 


95 


21. 9789 


Total 


2378.0400 


99 


9 



*P5'.025. ' 
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Overgeneralization 
Analysis of Variance 





Sum of Squares 


Df 


Mean Squar£ 


F Ratio 


Between Groups 


321. 9600 


4 


80. 4900 


3. 3873* 


Within Groups 


2257.4000 


95 


23. 7621 




Total 


2579.3600 


99 







*p<.025. 
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